-- Logs begin at Fri 2022-09-23 14:32:25 UTC, end at Fri 2022-09-23 15:43:51 UTC. -- Sep 23 15:09:23.798233 dv-cinder-855013-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 15:09:23.807310 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 15:09:23 2022] *** Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: nodename: dv-cinder-855013-3-iscsi Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: machine: x86_64 Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: clock source: unix Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: pcre jit disabled Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: detected number of CPU cores: 4 Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: current working directory: / Sep 23 15:09:23.809435 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: detected binary path: /usr/bin/uwsgi-core Sep 23 15:09:23.810085 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: your processes number limit is 47680 Sep 23 15:09:23.810085 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: your memory page size is 4096 bytes Sep 23 15:09:23.810085 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: detected max file descriptor number: 2048 Sep 23 15:09:23.810085 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: lock engine: pthread robust mutexes Sep 23 15:09:23.810085 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: thunder lock: enabled Sep 23 15:09:23.810085 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 15:09:23.810085 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 15:09:23.848182 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: Python main interpreter initialized at 0x55a08c6ff9c0 Sep 23 15:09:23.848182 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: python threads support enabled Sep 23 15:09:23.848182 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: your server socket listen backlog is limited to 100 connections Sep 23 15:09:23.848182 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: your mercy for graceful operations on workers is 90 seconds Sep 23 15:09:23.848552 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 15:09:23.848552 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: *** Operational MODE: preforking *** Sep 23 15:09:23.848874 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: *** uWSGI is running in multiple interpreter mode *** Sep 23 15:09:23.848874 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: spawned uWSGI master process (pid: 105883) Sep 23 15:09:23.849071 dv-cinder-855013-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 15:09:23.850455 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: spawned uWSGI worker 1 (pid: 105884, cores: 1) Sep 23 15:09:23.850455 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: spawned uWSGI worker 2 (pid: 105885, cores: 1) Sep 23 15:09:23.850455 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 15:09:24.514787 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 15:09:24.520908 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 15:09:25.595688 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:09:25.595688 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: from cryptography.utils import int_from_bytes Sep 23 15:09:25.596231 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:09:25.596231 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: from cryptography.utils import int_from_bytes Sep 23 15:09:25.598902 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:09:25.598902 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: from cryptography.utils import int_from_bytes Sep 23 15:09:25.599354 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:09:25.599354 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: from cryptography.utils import int_from_bytes Sep 23 15:09:28.036074 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:09:28.036802 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:09:28.036898 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:09:28.037209 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:09:28.037476 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:09:28.037847 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.038170 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.038493 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.038800 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.039125 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.039429 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.039736 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.040046 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.040144 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:09:28.040532 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:09:28.040652 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.040652 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.040903 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:09:28.040999 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.041239 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855013-3-iscsi {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.041349 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:09:28.041509 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:09:28.041597 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.041848 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.041937 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.042164 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.042260 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.042476 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.042566 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.042774 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.042874 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.043091 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.043179 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.043392 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.043488 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.043737 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.043884 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.044046 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.045129 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.045263 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.045394 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.045569 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.045659 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.045798 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.045892 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.045975 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855013-3-iscsi {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046065 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046157 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046236 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046313 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046435 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046516 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046612 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046691 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046812 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.046902 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.047043 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.047197 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.047359 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.047460 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855013-3-iscsi {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.047741 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.047866 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.048050 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.048180 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.048362 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.048491 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.048793 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.048908 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.049101 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.049186 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.049407 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.049492 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.049723 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.049826 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.050145 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.050293 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.050436 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.050570 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.050759 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.050871 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.051100 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.051187 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.051414 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.051516 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855013-3-iscsi {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.051730 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.051823 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.052031 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.052115 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.052336 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.052418 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.052664 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.052804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.052987 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.053117 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.053290 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.053425 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.053590 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.053758 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.053851 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.054071 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.054158 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.054386 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.054461 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.054716 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.054799 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.055037 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.055118 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.055280 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.055362 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.055526 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.055662 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.055837 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.055965 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.056153 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.056275 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.056460 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.056598 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.056788 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.056926 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.057091 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.057233 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.057395 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.057538 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.057697 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.057790 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.057999 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.058083 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.058299 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.058405 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.058602 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.058721 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.058921 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.059048 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.059230 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.059306 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.059539 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.059619 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.059841 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.059915 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.060156 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.060230 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.060464 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.060548 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.060802 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.060879 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.061107 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.061188 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.061415 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.061489 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.061724 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.061800 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.062034 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.062113 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.062338 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.062428 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.062649 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.062723 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.062957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.063037 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.063258 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.063342 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.063559 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.063634 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.063873 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.063947 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.064204 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.064304 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.064493 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.064765 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.064969 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.065217 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.065293 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.065611 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.065786 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.065978 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.066229 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.066398 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.066592 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.066939 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.067035 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.067238 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.067482 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.067587 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.067833 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.068046 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.068156 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.068427 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.068654 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.068751 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.069049 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.069208 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.069351 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.069653 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.069738 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.069955 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.070254 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.070347 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.070572 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.070844 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.070929 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.071174 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.071359 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.071679 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.071754 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.071948 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.072036 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.072235 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.072319 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.072551 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.072718 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.072885 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.072962 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.073191 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.073275 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.073503 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.073584 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.073802 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.073876 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.074100 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.074203 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.074412 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.074516 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.074711 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.074804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.075012 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.075099 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.075318 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.075413 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.075611 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.075695 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.075914 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.076007 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.076220 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.076347 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.076517 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.076630 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.076841 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.076930 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.077141 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.077227 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.077439 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.077527 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.077736 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.077833 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.078035 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.078121 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.078332 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.078432 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.078631 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.078730 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.078924 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.079010 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.079236 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.079338 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.079541 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.079626 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.079843 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.079927 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.080145 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.080239 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.080445 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.080537 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.080773 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.080862 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.081081 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.081212 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.081514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.081687 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.081849 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.082151 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.082247 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.082455 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.082542 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.082762 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.082855 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.083080 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.083176 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.083386 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.083471 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.083726 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.083825 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.084001 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.084096 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.084310 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.084412 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.084635 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.084779 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.084946 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.085041 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.085247 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.085339 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.085555 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.085648 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.085854 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.085948 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.086175 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.086269 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.086485 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.086580 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.086799 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.086884 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.087105 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.087189 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.087408 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.087491 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.087722 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.087815 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:09:28.088046 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.088139 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.088367 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.088454 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.088698 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.088798 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.089044 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.089195 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.089388 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.089543 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.089788 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.089961 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.090114 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.090370 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.090486 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.090710 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.090917 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.091042 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.091355 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.091479 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.091666 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.091979 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.092089 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.092303 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.092580 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.092720 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.092968 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.093234 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.093329 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.093593 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.093809 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.093902 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.094220 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.094384 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.094545 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.094880 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.094977 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.095207 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.095528 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.095623 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.095870 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.096132 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.096218 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.096525 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.096783 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.096907 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.097235 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.097392 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.097529 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.097929 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.098640 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.098733 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.098815 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.099095 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.099182 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.099633 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.099727 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.100167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.100306 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.100728 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.100866 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.101248 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.101457 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.101766 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.102041 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.102268 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.102609 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.102759 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.102951 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.103242 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.103460 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.103739 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.103873 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.104169 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.104330 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.104488 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.104791 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.104928 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.105137 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.105295 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.105448 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.105776 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.105861 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.106115 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.106298 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.106425 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.106764 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.106871 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.107074 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.107287 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.107380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.107686 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.107771 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.107996 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.108259 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.108345 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.108629 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.108780 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.108926 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.109231 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.109323 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.109550 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.109734 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.109861 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.110170 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.110257 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.110490 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.110697 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.110850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.111085 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.111170 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.111398 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.111659 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.111745 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.111999 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.112174 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.112308 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.112758 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.112924 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.113114 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.113641 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.113777 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.113986 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.114083 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.114322 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.114418 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.114649 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.114742 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.114974 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.115072 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.115292 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.115387 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.115615 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.115701 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.115927 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.116014 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.116229 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.116325 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.116538 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.116651 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.116869 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.116967 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.117167 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.117281 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.117473 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.117559 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.117777 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.117863 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.118075 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.118162 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.118374 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.118461 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.118675 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.118761 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.118976 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.119062 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.119276 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.119363 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.119593 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.119687 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.119897 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.119984 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.120196 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.120289 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.120502 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.120747 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.120860 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.120935 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.121144 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.121243 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.121444 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.121542 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.121783 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.121871 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.122114 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.122202 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.122428 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.122525 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.122744 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.122832 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.123118 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.123217 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.123361 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.123458 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.124098 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.124205 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.124205 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.124352 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.124430 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.124950 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125056 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125135 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125135 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125290 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125382 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125463 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125547 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125631 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125773 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.125868 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.126091 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.126184 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.126399 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.126492 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.126702 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.126810 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.127005 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.127102 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.127567 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.127669 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.127669 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.127822 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.128323 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.128412 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.128493 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.128579 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.128700 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.129001 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.129097 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.129316 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.129404 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.129647 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.129738 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.129946 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.130048 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.130255 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.130343 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.130563 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.131019 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.131019 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.131186 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.131276 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.131356 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.131833 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.131913 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.132000 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.132081 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.132160 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.132247 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.132362 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.132450 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.132690 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.132781 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.133008 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.133094 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.133309 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.133417 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.133623 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.133708 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.133947 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.134033 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.134496 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.134587 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.134668 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.134746 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.135233 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.135317 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.135396 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.135489 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.135569 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.135647 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.135747 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.135834 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.136055 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.136156 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.136357 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.136455 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.136681 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.136770 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.136988 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.137090 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.137306 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.137426 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.137613 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.137712 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.137918 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.138015 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.138219 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.138315 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.138530 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.138627 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.138833 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.138928 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.139132 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.139273 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.139414 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.139547 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.139720 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.139896 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.140027 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.140165 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.140318 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.140452 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.140649 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.140783 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.140968 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.141110 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.141271 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.141416 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.141573 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.141708 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.141891 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.142032 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.142195 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.142348 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.142484 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.142614 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.142788 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.142933 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.143088 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.143232 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.143427 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.143560 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.143822 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.144015 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.144178 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.144401 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.144578 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.144767 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.144854 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.145121 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.145231 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.145387 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.145474 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.145696 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.145783 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.146009 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.146105 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.146331 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.146425 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.146644 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.146741 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.146958 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.147053 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.147269 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.147388 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.147574 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.147660 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.147882 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.147981 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.148190 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.148277 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.148497 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.148603 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.148840 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.148928 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.149149 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.149234 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.149456 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.149548 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.149765 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.149853 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.150067 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.150215 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.150373 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.150460 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.150687 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.150774 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.151012 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.151267 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.151355 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.151603 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.151700 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.151924 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.152011 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.152241 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.152327 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.152568 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.152688 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.152905 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.153005 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.153218 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.153311 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.153533 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.153634 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.153848 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.153934 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.154149 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.154235 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.154460 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.154559 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.154764 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.154858 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.155069 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.155214 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.155380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.155561 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.155684 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.155771 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.155988 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.156080 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.156289 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.156383 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.156611 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.156713 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.156919 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.157229 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.157331 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.157510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.157597 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.157815 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.157901 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.158127 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.158222 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.158429 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.158515 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.158737 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.158838 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.159040 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.159126 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.159485 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.159623 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.159803 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.159972 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.160241 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.160333 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.160545 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.160673 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.160872 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.160958 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.161214 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.161300 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.161519 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.161614 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.161826 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.161911 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.162137 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.162223 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.162446 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.162532 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.162759 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.162847 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.163061 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.163159 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.163368 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.163453 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.163675 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.163769 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.163973 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.164066 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.164270 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.164357 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.164576 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.164713 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.164900 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.164999 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.165198 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.165304 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.165505 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.165592 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.165810 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.165906 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.166113 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.166199 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.166415 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.166507 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.166713 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.166800 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.167016 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.167102 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.167313 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.167443 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.167625 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.167713 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.167931 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.168016 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.168232 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.168317 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.168534 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.168640 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.168866 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.168953 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.169172 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.169272 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.169470 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.169555 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.169773 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.169859 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.170071 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.170209 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.170381 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.170469 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.170680 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.170765 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.170978 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.171073 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.171275 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.171363 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.171578 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.171664 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.171881 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.171976 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.172180 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.172267 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.172481 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.172566 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.172813 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.172913 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.173119 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.173206 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.173422 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.173507 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.173726 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.173813 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.174024 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.174118 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.174321 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.174408 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.174625 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.174712 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.175008 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.175123 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.175343 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.175500 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.175645 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.175740 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.175944 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.176032 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.176244 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.176333 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.176548 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.176661 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.176873 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.176959 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.177176 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.177280 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.177472 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.177558 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.177774 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.177873 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.178073 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.178169 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.178373 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.178459 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.178673 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.178765 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.178982 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.179076 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.179284 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.179377 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.179588 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.179682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.179891 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.179985 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.180189 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.180316 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.180498 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.180618 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.180843 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.180930 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.181158 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.181254 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.181463 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.181558 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.181777 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.181866 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.182083 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.182176 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.182387 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.182473 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.182690 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.182776 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.182998 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.183082 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.183300 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.183390 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.183606 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.183694 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.183909 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.183995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.184219 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.184313 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.184515 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.184620 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.184842 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.184940 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.185159 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.185255 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.185465 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.185551 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.185771 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.185856 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.186079 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.186173 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.186393 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.186478 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.186713 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.186799 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.187011 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.187110 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.187316 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.187402 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.187622 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.187715 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.187927 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.188014 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.188234 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.188320 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.188538 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.188673 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.188873 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.188961 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.189183 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.189277 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.189488 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.189583 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.189794 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.189882 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.190100 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.190187 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.190405 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.190524 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.190810 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.190946 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.191117 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.191275 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.191421 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.191534 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.191716 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.191849 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.192022 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.192109 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.192321 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.192421 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.192644 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.192735 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.192948 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.193036 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.193260 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.193357 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.193560 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.193646 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.193867 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.193988 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.194182 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.194277 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.194495 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.194581 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.194806 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.194905 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.195122 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.195257 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.195433 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.195519 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.195744 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.195871 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.196048 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.196134 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.196346 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.196433 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.196681 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.196781 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.196997 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.197084 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.197303 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.197399 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.197626 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.197754 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.197937 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.198026 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.198242 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.198328 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.198544 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.198639 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.198847 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.198932 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.199149 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.199233 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.199448 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.199549 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.199748 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.199879 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.200065 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.200194 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.200365 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.200496 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.200701 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.200823 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.201115 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.201202 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.201425 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.201521 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.201727 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.201820 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.202040 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.202124 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.202346 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.202433 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.202722 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.202807 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.203042 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.203134 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.203363 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.203449 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.203676 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.203771 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.203975 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.204059 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.204282 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.204376 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.204611 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.204712 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.204923 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.205010 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.205229 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.205315 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.205541 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.205671 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.205907 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.206022 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.206185 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.206335 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.206494 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.206647 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.206808 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.206945 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.207101 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.207380 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.207498 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.207689 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.207794 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.208018 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.208124 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.208395 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.208482 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.208744 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.208834 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.209059 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.209157 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.209356 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.209443 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.209659 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.209747 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.209964 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.210051 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.210265 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.210360 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.210567 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.210665 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.210886 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.211065 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.211208 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.211345 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.211479 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.211612 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.211754 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.211895 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.212062 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.212197 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.212361 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.212514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.212697 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.212797 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.212988 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.213089 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.213292 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.213379 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.213607 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.213704 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.213917 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.214055 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.214234 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.214389 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.214551 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.214703 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.214852 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.215030 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.215167 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.215361 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.215458 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.215671 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.215769 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.215974 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.216106 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.216286 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.216383 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.216611 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.216702 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.216926 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.217024 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.217252 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.217350 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.217561 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.217648 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.217877 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.217985 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.218180 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.218278 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.218487 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.218597 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.218791 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.218886 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.219097 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.219193 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.219409 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.219512 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.219711 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.219805 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.220030 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.220124 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.220330 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.220425 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.220647 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.220750 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.220953 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.221085 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.221251 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.221338 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.221549 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.221646 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.222017 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.222174 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.222330 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.222465 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.222615 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.222718 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.222916 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.223003 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.223223 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.223308 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.223541 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.223638 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.223841 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.223927 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.224159 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.224245 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.224466 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.224561 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.224794 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.224881 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.225095 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.225181 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.225392 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.225479 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.225730 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.225839 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.226030 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.226138 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.226356 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.226465 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.226661 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.226749 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.226982 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.227069 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.227293 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.227379 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.227601 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.227686 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.227905 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.227986 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.228205 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.228290 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.228515 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.228691 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.228848 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.228944 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.229151 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.229237 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.229454 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.229540 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.229757 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.229855 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.230067 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.230161 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.230372 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.230457 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.230696 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.230883 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.231009 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.231208 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.231317 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.231520 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.231627 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.231830 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.231938 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.232139 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.232281 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.232448 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.232618 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.232782 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.232942 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.233098 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.233254 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.233408 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.233581 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.233714 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.233902 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.234020 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.234227 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.234342 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.234545 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.234660 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.234864 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.234981 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.235179 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.235345 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.235497 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.235611 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.235814 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.235922 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.236129 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.236221 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.236448 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.236543 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.236800 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.236887 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.237120 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.237220 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.237526 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.237685 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.237837 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.238004 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.238146 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.238665 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.238795 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.238980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.239103 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.239297 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.239395 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.239614 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.239701 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.239928 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.240022 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.240245 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.240341 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.240559 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.240681 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.240899 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.240997 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.241206 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.241293 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.241526 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.241621 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.241849 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.241934 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.242163 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.242249 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.242473 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.242560 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.242782 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.242868 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.243100 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.243187 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.243414 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.243609 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.243732 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.243917 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.244095 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.244243 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.244416 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.244560 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.244750 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.244901 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.245070 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.245216 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.245388 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.245531 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.245707 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.245854 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.246021 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.246158 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.246335 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.246457 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.246652 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.246749 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.246964 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.247053 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.247276 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.247363 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.247586 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.247674 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.247901 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.247988 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.248218 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.248313 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.248528 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.248634 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.248857 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.248956 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.249200 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.249382 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.249517 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.249732 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.249819 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.250042 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.250128 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.250363 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.250639 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.250726 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.250954 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.251042 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.251272 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.251366 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.251590 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.251676 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.251895 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.251982 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.252197 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.252291 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.252509 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.252623 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.252844 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.252930 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.253230 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.253323 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.253535 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.253629 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.253844 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.254026 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.254148 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.254352 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.254439 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.254663 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.254749 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.254994 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.255086 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.255309 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.255405 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.255616 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.255703 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.255913 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.256008 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.256218 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.256313 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.256526 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.257058 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.257172 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.257264 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.257344 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.257422 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.257499 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.257712 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.257807 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.258016 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.258103 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.258314 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.258401 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.258617 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.258713 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.258916 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.259009 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.259222 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.259309 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.259537 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.259636 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.259856 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.259943 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.260155 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.260247 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.260466 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.260552 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.260800 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.260888 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.261098 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.261183 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.261410 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.261497 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.261716 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.261809 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.262024 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.262123 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.262327 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.262414 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.262632 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.262733 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.262951 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.263036 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.263260 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.263347 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.263569 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.263790 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.263880 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.264120 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.264207 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.264439 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.264525 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.264794 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.264880 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.265104 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.265193 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.265412 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.265497 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.265716 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.265800 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.266015 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.266108 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.266318 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.266406 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.266628 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.266723 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.266937 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.267032 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.267241 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.267327 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.267546 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.267646 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.267853 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.267941 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.268159 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.268254 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.268465 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.268561 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.268831 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.268981 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.269139 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.269355 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.269441 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.269689 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.269777 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.270009 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.270103 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.270321 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.270415 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.270628 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.270714 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.270938 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.271031 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.271273 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.271504 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.271591 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.271848 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.271944 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.272177 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.272263 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.272485 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.272571 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.272815 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.272902 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.273135 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.273221 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.273440 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.273528 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.273745 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.273838 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.274054 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.274149 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.274380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.274467 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.274689 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.274782 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.274990 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.275087 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.275303 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.275616 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.275700 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.275931 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.276018 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.276248 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.276337 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.276562 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277039 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277039 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277257 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277355 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277436 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277523 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277796 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.277893 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.278110 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.278195 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.278420 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.278513 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.278735 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.278839 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.279065 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.279159 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.279386 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.279474 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.279704 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.279790 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.280003 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.280100 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.280303 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.280403 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.280616 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.280706 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.280928 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.281015 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.281243 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.281387 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.281550 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.281646 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.281848 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.281935 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.282145 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.282232 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.282450 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.282538 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.282748 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.282835 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.283053 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.283352 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.283446 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.283650 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.283737 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.283953 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.284073 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.284317 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.284476 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.284653 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.284824 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.284957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.285156 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.285261 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.285488 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.285576 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.285807 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.285895 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.286159 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.286251 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.286413 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.286489 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.286714 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.286810 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.287011 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.287098 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.287309 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.287395 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.287606 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.287721 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.287938 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.288026 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.288266 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.288352 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.288576 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.288758 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.288913 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.289009 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.289216 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.289303 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.289534 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.289630 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.289842 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.289933 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.290155 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.290248 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.290465 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.290559 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.290771 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.290857 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.291072 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.291158 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.291377 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.291473 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.291685 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.291772 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.291988 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.292073 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.292291 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.292377 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.292616 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.292705 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.292920 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.293007 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.293225 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.293320 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.293529 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.293613 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.293837 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.293930 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.294141 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.294236 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.294451 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.294543 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.294758 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.294845 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.295064 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.295151 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.295368 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.295456 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.295674 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.295768 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.295996 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.296089 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.296301 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.296391 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.296620 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.296727 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.296933 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.297020 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.297240 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.297333 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.297548 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.297643 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.297858 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.298009 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.298165 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.298262 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.298470 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.298558 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.298781 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.298867 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.299092 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.299179 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.299414 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.299501 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.299725 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.299818 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.300098 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.300189 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.300422 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.300544 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.300773 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.300880 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.301122 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.301210 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.301435 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.301555 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.301766 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.301852 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.302093 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.302193 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.302400 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.302494 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.302711 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.302798 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.303016 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.303115 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.303255 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:09:28.303342 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.303649 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.303970 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.304306 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.304644 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.304961 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.305276 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.305590 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.305903 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.306235 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.306554 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.306869 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.307189 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.307510 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.307841 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.308171 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.308488 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.308855 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.309187 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.309538 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.309854 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.310205 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.310537 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.310858 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.311175 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.311483 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:09:28.311729 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:09:28.461355 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO dbcounter [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Registered counter for database nova_api Sep 23 15:09:28.469304 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO dbcounter [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Registered counter for database nova_api Sep 23 15:09:28.482536 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_db.sqlalchemy.engines [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:09:28.489987 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_db.sqlalchemy.engines [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:09:28.491044 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writer thread running {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:09:28.499596 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writer thread running {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:09:28.552394 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.context [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e080b19-aa0c-4000-9579-fc774adbca9b(cell1) {{(pid=105885) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 15:09:28.556237 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.context [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e080b19-aa0c-4000-9579-fc774adbca9b(cell1) {{(pid=105884) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 15:09:28.556377 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_concurrency.lockutils [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:09:28.556849 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_concurrency.lockutils [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:09:28.558390 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_concurrency.lockutils [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:09:28.559112 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_concurrency.lockutils [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:09:28.559547 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_concurrency.lockutils [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:09:28.560099 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:09:28.560566 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:09:28.561567 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_concurrency.lockutils [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:09:28.562135 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:09:28.562849 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:09:28.563277 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:09:28.563586 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO dbcounter [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Registered counter for database nova_cell0 Sep 23 15:09:28.565271 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:09:28.567298 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO dbcounter [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Registered counter for database nova_cell0 Sep 23 15:09:28.567796 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO dbcounter [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Registered counter for database nova_cell1 Sep 23 15:09:28.571266 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO dbcounter [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Registered counter for database nova_cell1 Sep 23 15:09:28.575458 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_db.sqlalchemy.engines [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:09:28.577566 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_db.sqlalchemy.engines [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:09:28.581004 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_db.sqlalchemy.engines [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:09:28.584505 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writer thread running {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:09:28.584718 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_db.sqlalchemy.engines [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:09:28.586768 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writer thread running {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:09:28.587207 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writer thread running {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:09:28.723438 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writer thread running {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:09:28.728724 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO dbcounter [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Registered counter for database nova_cell0 Sep 23 15:09:28.732655 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO dbcounter [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Registered counter for database nova_cell0 Sep 23 15:09:28.739160 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG oslo_db.sqlalchemy.engines [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:09:28.742743 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_db.sqlalchemy.engines [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:09:28.745010 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writer thread running {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:09:28.747368 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writer thread running {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:09:29.081278 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: WARNING keystonemiddleware.auth_token [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:09:29.084226 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: WARNING keystonemiddleware.auth_token [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:09:29.088551 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: WARNING keystonemiddleware.auth_token [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:09:29.091460 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: WARNING keystonemiddleware.auth_token [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:09:29.428507 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: WARNING keystonemiddleware.auth_token [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:09:29.434431 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: WARNING keystonemiddleware.auth_token [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:09:29.438828 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: WARNING keystonemiddleware.auth_token [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:09:29.439681 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a08c6ff9c0 pid: 105884 (default app) Sep 23 15:09:29.441953 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:09:29.443119 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 Sep 23 15:09:29.443512 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Fri Sep 23 15:09:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:09:29.444869 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: WARNING keystonemiddleware.auth_token [None req-987c661b-a907-4d01-85ee-d896e12b14d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:09:29.450171 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a08c6ff9c0 pid: 105885 (default app) Sep 23 15:10:52.184879 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:10:52.186664 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002240 Sep 23 15:10:52.187258 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:10:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:10:52.204798 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writing DB stats nova_api:SELECT=3 {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:52.206044 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writing DB stats nova_cell1:SELECT=3 {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:52.213335 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writing DB stats nova_cell0:SELECT=3 {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:52.214179 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:53.076414 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-b77a67ed-a26c-4088-a62e-81307749dcc6 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:10:53.109043 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-b77a67ed-a26c-4088-a62e-81307749dcc6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914973 Sep 23 15:10:53.109929 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1292 bytes} [Fri Sep 23 15:10:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:55.719186 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:10:55.720234 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-c00e2ffc-d1ff-441e-a398-9f1dcddd6b2e None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 23 15:10:55.724864 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:10:55 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:10:56.161649 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-2ae920a5-4051-439f-ad00-7fb981473ea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:10:56.210721 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-2ae920a5-4051-439f-ad00-7fb981473ea4 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482979 Sep 23 15:10:56.211302 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:10:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:10:56.224879 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_api:SELECT=3 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:56.227254 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_cell0:SELECT=3 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:56.228963 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_cell1:SELECT=3 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:56.229699 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:56.433139 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-28aefa8d-852e-42dd-8df1-ab5469311734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:10:56.505353 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-28aefa8d-852e-42dd-8df1-ab5469311734 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285498 Sep 23 15:10:56.506268 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Sep 23 15:10:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:59.145494 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-2ae920a5-4051-439f-ad00-7fb981473ea4 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:10:59.146551 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-2ae920a5-4051-439f-ad00-7fb981473ea4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Sep 23 15:10:59.147176 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:10:59.995082 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-aa334ee9-c80e-4f3c-ada8-58c7e77306e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "swap": 0, "vcpus": 1}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:00.046337 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-aa334ee9-c80e-4f3c-ada8-58c7e77306e5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.892064 Sep 23 15:11:00.047381 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:10:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:00.063947 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-b23531a9-38e8-43cd-9751-910e84e31680 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:00.113951 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-b23531a9-38e8-43cd-9751-910e84e31680 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057643 Sep 23 15:11:00.114897 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Sep 23 15:11:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:11:02.728417 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-aa334ee9-c80e-4f3c-ada8-58c7e77306e5 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:02.729588 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-aa334ee9-c80e-4f3c-ada8-58c7e77306e5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Sep 23 15:11:02.729973 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:03.152830 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-b8bba61e-5032-4b15-89a2-648290720e85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:03.174929 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-b8bba61e-5032-4b15-89a2-648290720e85 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437386 Sep 23 15:11:03.175066 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:11:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:03.187565 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-13db6ed5-17a0-48c3-a97d-6891e0cc3033 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:03.218444 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-13db6ed5-17a0-48c3-a97d-6891e0cc3033 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034563 Sep 23 15:11:03.219235 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Sep 23 15:11:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:11:05.826156 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-b8bba61e-5032-4b15-89a2-648290720e85 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:05.827168 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-b8bba61e-5032-4b15-89a2-648290720e85 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 23 15:11:05.827533 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:06.284688 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-a8f11cb6-bc8a-422c-a35c-3cb2b11f7bb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "swap": 0, "id": "d3", "disk": 10}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:06.308569 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-a8f11cb6-bc8a-422c-a35c-3cb2b11f7bb4 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474912 Sep 23 15:11:06.312629 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:11:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:11:06.321350 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-cf7f3d55-6dd8-4377-ad31-9e22ebe9451b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:06.349357 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-cf7f3d55-6dd8-4377-ad31-9e22ebe9451b admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031727 Sep 23 15:11:06.349945 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Sep 23 15:11:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:11:08.948507 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-a8f11cb6-bc8a-422c-a35c-3cb2b11f7bb4 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:08.949472 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-a8f11cb6-bc8a-422c-a35c-3cb2b11f7bb4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 23 15:11:08.949874 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:09.388198 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-6d5e3eac-f659-4be7-8bb3-267f488f8472 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:09.409035 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-6d5e3eac-f659-4be7-8bb3-267f488f8472 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452861 Sep 23 15:11:09.409614 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:11:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:11:09.423599 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-a7554c4b-32cc-48c5-a959-172395f9e52d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:09.455237 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-a7554c4b-32cc-48c5-a959-172395f9e52d admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036630 Sep 23 15:11:09.455854 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1336 bytes} [Fri Sep 23 15:11:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:11:12.082873 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-6d5e3eac-f659-4be7-8bb3-267f488f8472 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:12.083975 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-6d5e3eac-f659-4be7-8bb3-267f488f8472 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Sep 23 15:11:12.084399 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:12.536734 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-e803fdaf-6f12-464e-9fda-355ff0782d3f admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:12.569815 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-e803fdaf-6f12-464e-9fda-355ff0782d3f admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.478070 Sep 23 15:11:12.570794 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1292 bytes} [Fri Sep 23 15:11:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:11:15.398644 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-6d5e3eac-f659-4be7-8bb3-267f488f8472 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:15.401477 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-6d5e3eac-f659-4be7-8bb3-267f488f8472 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Sep 23 15:11:15.401477 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:15.818842 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-c72d62d3-af47-49d2-8de5-5986584b0a82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "id": "1", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:15.866546 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-c72d62d3-af47-49d2-8de5-5986584b0a82 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459679 Sep 23 15:11:15.867835 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:11:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:15.882486 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-044723e4-b480-4b49-956a-370273f3479a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:15.913490 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-044723e4-b480-4b49-956a-370273f3479a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035778 Sep 23 15:11:15.914396 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Sep 23 15:11:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:11:18.567639 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-c72d62d3-af47-49d2-8de5-5986584b0a82 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:18.568685 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-c72d62d3-af47-49d2-8de5-5986584b0a82 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 23 15:11:18.569082 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:18.979405 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-4882c22e-ada1-47c4-a77b-9dff14167d30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:19.001437 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-4882c22e-ada1-47c4-a77b-9dff14167d30 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425390 Sep 23 15:11:19.002668 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:11:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:19.014940 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-29a5c920-4a6e-4607-adfa-373965bfd0b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:19.047156 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-29a5c920-4a6e-4607-adfa-373965bfd0b9 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035888 Sep 23 15:11:19.060760 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Sep 23 15:11:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:11:21.702458 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-4882c22e-ada1-47c4-a77b-9dff14167d30 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:21.703404 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-4882c22e-ada1-47c4-a77b-9dff14167d30 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 23 15:11:21.703844 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:22.144457 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-a4bc4720-e59c-4d30-b508-bc01f804eefd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:22.183143 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-a4bc4720-e59c-4d30-b508-bc01f804eefd admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.472313 Sep 23 15:11:22.183869 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:11:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:22.197195 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-ba697acc-7938-4b4c-9029-6ca3bf86d8d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:22.225716 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-ba697acc-7938-4b4c-9029-6ca3bf86d8d0 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033269 Sep 23 15:11:22.240864 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Sep 23 15:11:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:11:24.843625 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-a4bc4720-e59c-4d30-b508-bc01f804eefd admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:24.844683 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-a4bc4720-e59c-4d30-b508-bc01f804eefd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 23 15:11:24.845075 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:25.307827 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-5b8a15fa-c9e3-4933-9b85-0ab324c9a4ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "disk": 80, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:25.314548 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:25.391416 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-5b8a15fa-c9e3-4933-9b85-0ab324c9a4ef admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539969 Sep 23 15:11:25.392329 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:11:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:11:25.404854 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-2200ef7a-3686-4e5d-9900-fd53ca249721 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:25.448649 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-2200ef7a-3686-4e5d-9900-fd53ca249721 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047407 Sep 23 15:11:25.449424 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Sep 23 15:11:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:11:28.063808 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-5b8a15fa-c9e3-4933-9b85-0ab324c9a4ef admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:28.064925 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-5b8a15fa-c9e3-4933-9b85-0ab324c9a4ef admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 23 15:11:28.065325 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:28.512377 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-8c009a83-c9cc-4a51-985c-5df9337e4002 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:28.518912 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:28.537078 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-8c009a83-c9cc-4a51-985c-5df9337e4002 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465559 Sep 23 15:11:28.537984 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1283 bytes} [Fri Sep 23 15:11:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:28.551270 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-0f66975b-afd8-478a-95ef-7ddcf3aa2cca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:28.579834 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-0f66975b-afd8-478a-95ef-7ddcf3aa2cca admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032493 Sep 23 15:11:28.592648 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1333 bytes} [Fri Sep 23 15:11:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:11:45.520636 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-8c009a83-c9cc-4a51-985c-5df9337e4002 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:45.521672 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-8c009a83-c9cc-4a51-985c-5df9337e4002 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 23 15:11:45.522071 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:45.536769 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:45.975572 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-fb6b8f0d-5d81-42c1-8973-e5682fca6669 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:45.994448 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-fb6b8f0d-5d81-42c1-8973-e5682fca6669 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.465615 Sep 23 15:11:45.995025 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1292 bytes} [Fri Sep 23 15:11:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:11:47.349376 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-8c009a83-c9cc-4a51-985c-5df9337e4002 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:47.350385 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-8c009a83-c9cc-4a51-985c-5df9337e4002 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 23 15:11:47.350787 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:47.936889 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-7faf18c3-5ba8-4817-83ab-d5ad8563dc83 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:47.942647 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.wsgi [None req-7faf18c3-5ba8-4817-83ab-d5ad8563dc83 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-7faf18c3-5ba8-4817-83ab-d5ad8563dc83 admin admin] Request method failure captured: Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Accept: application/json Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Accept-Encoding: gzip, deflate Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Connection: keep-alive Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Content-Length: 0 Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Host: 10.222.0.75 Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Openstack-Api-Version: compute 2.92 Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Openstack-System-Scope: None Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: User-Agent: python-novaclient Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Auth-Token: gAAAAABjLcyz3ne732KJTgE-aNXKrY9vfferB9dJ-BXVVAQd8K5xAPVtqshTX2yFqvx2UDfzYtUxVkqykniFFekuZxrlGaNMxIqQE_x6t0uiVIiHA4URFDsNQsEpoNMUpUjlMe8zMSy1UwoL3mCfg9ripFUDEKxDamWjRuZlXP-ryUwwXx1hTpg Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Domain-Id: None Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Domain-Name: None Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Identity-Status: Confirmed Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Is-Admin-Project: True Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Domain-Id: default Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Domain-Name: Default Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Name: admin Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Role: admin,reader,member Sep 23 15:11:47.945957 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Roles: admin,reader,member Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}] Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant: admin Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant-Name: admin Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User: admin Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Domain-Id: default Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Domain-Name: Default Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Id: 1d564d82faf2482faf5205415837bf68 Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Name: admin Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: method: > Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: exception: Flavor 42 could not be found. Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: action_args: {'id': '42'} Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:11:47.947380 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:47.948478 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:47.949896 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-7faf18c3-5ba8-4817-83ab-d5ad8563dc83 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:11:47.950931 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-7faf18c3-5ba8-4817-83ab-d5ad8563dc83 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.432920 Sep 23 15:11:47.950931 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Fri Sep 23 15:11:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:47.961360 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-1e3540ca-ae7a-4e72-9157-c129b0e3ee6e admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:47.990877 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-1e3540ca-ae7a-4e72-9157-c129b0e3ee6e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.035852 Sep 23 15:11:47.991607 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Sep 23 15:11:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:11:48.005547 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-4bb9666c-9a9a-4cbc-acbb-a673066ac9b6 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:48.030698 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-4bb9666c-9a9a-4cbc-acbb-a673066ac9b6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.032341 Sep 23 15:11:48.031240 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Sep 23 15:11:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:11:48.041272 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-1b555296-3022-4491-9863-7eb9674b8fbb admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:48.047199 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.wsgi [None req-1b555296-3022-4491-9863-7eb9674b8fbb admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-1b555296-3022-4491-9863-7eb9674b8fbb admin admin] Request method failure captured: Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Accept: application/json Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Accept-Encoding: gzip, deflate Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Connection: keep-alive Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Content-Length: 0 Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Host: 10.222.0.75 Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Openstack-Api-Version: compute 2.92 Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Openstack-System-Scope: None Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: User-Agent: python-novaclient Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Auth-Token: gAAAAABjLcyz3ne732KJTgE-aNXKrY9vfferB9dJ-BXVVAQd8K5xAPVtqshTX2yFqvx2UDfzYtUxVkqykniFFekuZxrlGaNMxIqQE_x6t0uiVIiHA4URFDsNQsEpoNMUpUjlMe8zMSy1UwoL3mCfg9ripFUDEKxDamWjRuZlXP-ryUwwXx1hTpg Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Domain-Id: None Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Domain-Name: None Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Identity-Status: Confirmed Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Is-Admin-Project: True Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Domain-Id: default Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Domain-Name: Default Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Name: admin Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Role: admin,reader,member Sep 23 15:11:48.050573 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Roles: admin,reader,member Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}] Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant: admin Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant-Name: admin Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User: admin Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Domain-Id: default Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Domain-Name: Default Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Id: 1d564d82faf2482faf5205415837bf68 Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Name: admin Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: method: > Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: exception: Flavor 42 could not be found. Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: action_args: {'id': '42'} Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:11:48.051980 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:48.052916 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:48.053995 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-1b555296-3022-4491-9863-7eb9674b8fbb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:11:48.055198 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-1b555296-3022-4491-9863-7eb9674b8fbb admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014422 Sep 23 15:11:48.055198 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Fri Sep 23 15:11:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:49.328747 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-4bb9666c-9a9a-4cbc-acbb-a673066ac9b6 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:49.329841 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-4bb9666c-9a9a-4cbc-acbb-a673066ac9b6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 23 15:11:49.330241 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:49.906519 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-31f96d4e-44ce-4557-80b7-9341f5676136 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:49.911619 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.wsgi [None req-31f96d4e-44ce-4557-80b7-9341f5676136 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-31f96d4e-44ce-4557-80b7-9341f5676136 admin admin] Request method failure captured: Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Accept: application/json Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Accept-Encoding: gzip, deflate Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Connection: keep-alive Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Content-Length: 0 Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Host: 10.222.0.75 Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Openstack-Api-Version: compute 2.92 Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Openstack-System-Scope: None Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: User-Agent: python-novaclient Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Auth-Token: gAAAAABjLcy1jU94_W9sxYgSkI6TELGJGxeR569kB3TUW0IkITahIxNAaXd2NBsYiRhTvHMTtKXIofFuKP51jwElUKmd4IwboVIhC7yzUeTQbVZCMqtaMOsS7BtXY5_eCIM3T3jVuXR6lkq7EMRq9Dytn6ZkcMcz5bzf_SwOEuZzU1mS39YkIl0 Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Domain-Id: None Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Domain-Name: None Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Identity-Status: Confirmed Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Is-Admin-Project: True Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Domain-Id: default Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Domain-Name: Default Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Name: admin Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Role: admin,reader,member Sep 23 15:11:49.913167 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Roles: admin,reader,member Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}] Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant: admin Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant-Name: admin Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User: admin Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Domain-Id: default Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Domain-Name: Default Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Id: 1d564d82faf2482faf5205415837bf68 Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Name: admin Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: method: > Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: exception: Flavor 84 could not be found. Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: action_args: {'id': '84'} Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:11:49.914682 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:49.915514 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.916804 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-31f96d4e-44ce-4557-80b7-9341f5676136 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:11:49.918657 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-31f96d4e-44ce-4557-80b7-9341f5676136 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.447959 Sep 23 15:11:49.918657 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Fri Sep 23 15:11:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:49.924843 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-1882d19f-0e08-452b-a215-10d7be568944 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:49.940838 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-1882d19f-0e08-452b-a215-10d7be568944 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019581 Sep 23 15:11:49.941340 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Sep 23 15:11:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:11:49.950990 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-ba910bba-57ee-41e1-865e-0d1895b8f3f0 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:49.967298 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-ba910bba-57ee-41e1-865e-0d1895b8f3f0 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019807 Sep 23 15:11:49.967816 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Sep 23 15:11:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:11:49.979851 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-f5995c65-1fa0-4124-add7-80e147d74899 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:49.987521 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.wsgi [None req-f5995c65-1fa0-4124-add7-80e147d74899 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-f5995c65-1fa0-4124-add7-80e147d74899 admin admin] Request method failure captured: Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Accept: application/json Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Accept-Encoding: gzip, deflate Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Connection: keep-alive Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Content-Length: 0 Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Host: 10.222.0.75 Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Openstack-Api-Version: compute 2.92 Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Openstack-System-Scope: None Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: User-Agent: python-novaclient Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Auth-Token: gAAAAABjLcy1jU94_W9sxYgSkI6TELGJGxeR569kB3TUW0IkITahIxNAaXd2NBsYiRhTvHMTtKXIofFuKP51jwElUKmd4IwboVIhC7yzUeTQbVZCMqtaMOsS7BtXY5_eCIM3T3jVuXR6lkq7EMRq9Dytn6ZkcMcz5bzf_SwOEuZzU1mS39YkIl0 Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Domain-Id: None Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Domain-Name: None Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Identity-Status: Confirmed Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Is-Admin-Project: True Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Domain-Id: default Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Domain-Name: Default Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Name: admin Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Role: admin,reader,member Sep 23 15:11:49.990188 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Roles: admin,reader,member Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}] Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant: admin Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant-Name: admin Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User: admin Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Domain-Id: default Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Domain-Name: Default Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Id: 1d564d82faf2482faf5205415837bf68 Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Name: admin Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: method: > Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: exception: Flavor 84 could not be found. Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: action_args: {'id': '84'} Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:11:49.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:49.992608 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:49.993683 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-f5995c65-1fa0-4124-add7-80e147d74899 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:11:49.994670 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-f5995c65-1fa0-4124-add7-80e147d74899 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.017693 Sep 23 15:11:49.994670 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Fri Sep 23 15:11:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 23 15:11:51.245646 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-ba910bba-57ee-41e1-865e-0d1895b8f3f0 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:51.246656 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-ba910bba-57ee-41e1-865e-0d1895b8f3f0 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Sep 23 15:11:51.247051 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:51.812707 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-bed80d0a-6126-4662-a6bb-f1a4eb059321 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:51.818772 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.wsgi [None req-bed80d0a-6126-4662-a6bb-f1a4eb059321 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-bed80d0a-6126-4662-a6bb-f1a4eb059321 admin admin] Request method failure captured: Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Accept: application/json Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Accept-Encoding: gzip, deflate Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Connection: keep-alive Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Content-Length: 0 Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Host: 10.222.0.75 Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Openstack-Api-Version: compute 2.92 Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Openstack-System-Scope: None Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: User-Agent: python-novaclient Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Auth-Token: gAAAAABjLcy3WDbuuBu-bcTqfLcmQ2y39JYfZOc8XWUMGoG18bb14QYqjXM3dCRPiqmxE0N2VVEpp7VcHZ9d2eDu0bWEFIrJWx1LYIHsaj22e4vWQvsb45arl_w2UkJFvx5CQ-JttT9TmWjCminAinuIV0BCCzzXLmv2-v-L2PP-BVf6MxARHZs Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Domain-Id: None Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Domain-Name: None Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Identity-Status: Confirmed Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Is-Admin-Project: True Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Domain-Id: default Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Domain-Name: Default Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Project-Name: admin Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Role: admin,reader,member Sep 23 15:11:51.820294 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Roles: admin,reader,member Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}] Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant: admin Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-Tenant-Name: admin Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User: admin Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Domain-Id: default Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Domain-Name: Default Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Id: 1d564d82faf2482faf5205415837bf68 Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: X-User-Name: admin Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: method: > Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: exception: Flavor 451 could not be found. Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: action_args: {'id': '451'} Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:11:51.821679 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:51.822510 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.823850 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-bed80d0a-6126-4662-a6bb-f1a4eb059321 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:11:51.825073 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-bed80d0a-6126-4662-a6bb-f1a4eb059321 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.437308 Sep 23 15:11:51.825073 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Sep 23 15:11:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:51.831883 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-c215462f-16a5-489f-be69-b250466eee6d admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:51.847462 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-c215462f-16a5-489f-be69-b250466eee6d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019255 Sep 23 15:11:51.847987 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Sep 23 15:11:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:11:51.857882 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:51.873617 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019574 Sep 23 15:11:51.874147 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Fri Sep 23 15:11:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:11:51.883547 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-a6969e95-fac7-41ef-8c3d-afa12c907ef6 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:51.888629 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.wsgi [None req-a6969e95-fac7-41ef-8c3d-afa12c907ef6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-a6969e95-fac7-41ef-8c3d-afa12c907ef6 admin admin] Request method failure captured: Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Accept: application/json Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Accept-Encoding: gzip, deflate Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Connection: keep-alive Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Content-Length: 0 Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Host: 10.222.0.75 Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Openstack-Api-Version: compute 2.92 Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Openstack-System-Scope: None Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: User-Agent: python-novaclient Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Auth-Token: gAAAAABjLcy3WDbuuBu-bcTqfLcmQ2y39JYfZOc8XWUMGoG18bb14QYqjXM3dCRPiqmxE0N2VVEpp7VcHZ9d2eDu0bWEFIrJWx1LYIHsaj22e4vWQvsb45arl_w2UkJFvx5CQ-JttT9TmWjCminAinuIV0BCCzzXLmv2-v-L2PP-BVf6MxARHZs Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Domain-Id: None Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Domain-Name: None Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Identity-Status: Confirmed Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Is-Admin-Project: True Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Domain-Id: default Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Domain-Name: Default Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Project-Name: admin Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Role: admin,reader,member Sep 23 15:11:51.890173 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Roles: admin,reader,member Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a6e3ae74e78241ac8bfc0ae2c7103bec"}]}] Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant: admin Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant-Id: a6e3ae74e78241ac8bfc0ae2c7103bec Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-Tenant-Name: admin Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User: admin Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Domain-Id: default Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Domain-Name: Default Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Id: 1d564d82faf2482faf5205415837bf68 Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: X-User-Name: admin Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: method: > Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: exception: Flavor 451 could not be found. Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: action_args: {'id': '451'} Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:11:51.891622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:51.892553 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: ERROR nova.api.openstack.wsgi Sep 23 15:11:51.893828 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-a6969e95-fac7-41ef-8c3d-afa12c907ef6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:11:51.895073 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-a6969e95-fac7-41ef-8c3d-afa12c907ef6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011610 Sep 23 15:11:51.895073 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Sep 23 15:11:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 15:11:53.154584 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:53.155827 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Sep 23 15:11:53.156346 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:53.739855 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-619ae9f7-193c-4353-ae40-97c302316e58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:53.763216 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-619ae9f7-193c-4353-ae40-97c302316e58 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.453008 Sep 23 15:11:53.763755 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Fri Sep 23 15:11:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:54.989972 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:54.990979 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Sep 23 15:11:54.991367 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:55.552756 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-9d6e5ea2-3b38-470d-ba70-85abec83c263 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:55.576792 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-9d6e5ea2-3b38-470d-ba70-85abec83c263 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.449075 Sep 23 15:11:55.577368 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Fri Sep 23 15:11:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:56.803356 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:56.804374 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 23 15:11:56.804806 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:57.363369 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-1edd3968-774f-4e43-8f20-054d6d91415b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:57.386153 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-1edd3968-774f-4e43-8f20-054d6d91415b admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.444151 Sep 23 15:11:57.386812 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Fri Sep 23 15:11:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:58.657332 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:11:58.658781 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Sep 23 15:11:58.659396 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:11:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:11:59.246285 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-64077eba-48b8-4b21-aa65-f3b370daeb28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:11:59.268692 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-64077eba-48b8-4b21-aa65-f3b370daeb28 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.469799 Sep 23 15:11:59.269247 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Fri Sep 23 15:11:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:00.662596 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:00.663611 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 23 15:12:00.663986 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:12:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:01.253221 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-6eca5f04-1cd0-479a-98a4-57d58f2a2471 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:01.274354 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-6eca5f04-1cd0-479a-98a4-57d58f2a2471 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.473955 Sep 23 15:12:01.275038 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Fri Sep 23 15:12:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:12:58.885842 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:58.886937 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-781b29dc-6a02-4409-b6f6-18f8879dca1c admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 23 15:12:58.887329 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 931 bytes} [Fri Sep 23 15:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:12:58.901622 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:59.306759 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-34f38123-5321-4ec4-b070-02391c6cd297 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:59.328769 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-34f38123-5321-4ec4-b070-02391c6cd297 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.434599 Sep 23 15:12:59.329206 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1292 bytes} [Fri Sep 23 15:12:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:12:59.355439 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writing DB stats nova_api:SELECT=14 {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:59.360911 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-f1bcc0c3-2b8c-4808-9e83-e834b8f9de66 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:59.372235 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-f1bcc0c3-2b8c-4808-9e83-e834b8f9de66 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019433 Sep 23 15:12:59.372796 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1283 bytes} [Fri Sep 23 15:12:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:59.384734 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-ee0b4e46-fb9f-4e0c-aec5-efe68e7ca610 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:59.392990 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-ee0b4e46-fb9f-4e0c-aec5-efe68e7ca610 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011721 Sep 23 15:12:59.393444 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1286 bytes} [Fri Sep 23 15:12:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:59.405165 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:59.412630 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011107 Sep 23 15:12:59.413164 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1286 bytes} [Fri Sep 23 15:12:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:12:59.424765 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-5b58c466-f4fc-4a7d-a747-2a7244b50f61 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:12:59.432171 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-5b58c466-f4fc-4a7d-a747-2a7244b50f61 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010856 Sep 23 15:12:59.432723 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1283 bytes} [Fri Sep 23 15:12:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:15:57.772056 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:15:57.773132 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 23 15:15:57.773525 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 34/69] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:15:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:15:57.914415 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_api:SELECT=6 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:15:58.113509 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-0ed515dc-2960-4b22-b2c5-b134e94ae0a9 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:15:58.118421 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-0ed515dc-2960-4b22-b2c5-b134e94ae0a9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:15:58.118901 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-0ed515dc-2960-4b22-b2c5-b134e94ae0a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:15:58.119323 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-0ed515dc-2960-4b22-b2c5-b134e94ae0a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:15:58.120032 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-0ed515dc-2960-4b22-b2c5-b134e94ae0a9 admin admin] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:15:58.120471 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-0ed515dc-2960-4b22-b2c5-b134e94ae0a9 admin admin] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:15:58.120914 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-0ed515dc-2960-4b22-b2c5-b134e94ae0a9 admin admin] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:15:58.152179 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-0ed515dc-2960-4b22-b2c5-b134e94ae0a9 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.239910 Sep 23 15:15:58.152761 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 36/70] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Sep 23 15:15:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:15:59.263574 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:15:59.264624 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 23 15:15:59.265026 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 35/71] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:15:59.467261 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-5daf96d4-b22e-4ec3-880a-7f76fad323a4 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:15:59.470660 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-5daf96d4-b22e-4ec3-880a-7f76fad323a4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:15:59.471135 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-5daf96d4-b22e-4ec3-880a-7f76fad323a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:15:59.471559 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-5daf96d4-b22e-4ec3-880a-7f76fad323a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:15:59.472282 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-5daf96d4-b22e-4ec3-880a-7f76fad323a4 admin admin] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:15:59.472749 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-5daf96d4-b22e-4ec3-880a-7f76fad323a4 admin admin] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:15:59.473157 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-5daf96d4-b22e-4ec3-880a-7f76fad323a4 admin admin] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:15:59.492820 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-5daf96d4-b22e-4ec3-880a-7f76fad323a4 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.086660 Sep 23 15:15:59.493409 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 37/72] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Sep 23 15:15:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:16:11.042888 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:16:11.043947 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 23 15:16:11.044356 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:16:11.187535 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_cell0:SELECT=4 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:16:11.188255 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_cell1:SELECT=4 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:16:11.188863 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG dbcounter [-] [105884] Writing DB stats nova_api:SELECT=8 {{(pid=105884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:16:11.242955 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-89e7d55e-a744-4954-afcf-79b3f4932d22 admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:16:11.246449 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-89e7d55e-a744-4954-afcf-79b3f4932d22 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:16:11.246861 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-89e7d55e-a744-4954-afcf-79b3f4932d22 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:16:11.247288 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-89e7d55e-a744-4954-afcf-79b3f4932d22 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:16:11.247996 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-89e7d55e-a744-4954-afcf-79b3f4932d22 admin admin] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:16:11.248437 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-89e7d55e-a744-4954-afcf-79b3f4932d22 admin admin] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:16:11.248875 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-89e7d55e-a744-4954-afcf-79b3f4932d22 admin admin] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:16:11.273695 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-89e7d55e-a744-4954-afcf-79b3f4932d22 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.090585 Sep 23 15:16:11.274248 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 38/74] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Sep 23 15:16:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:16:12.380064 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG nova.api.openstack.wsgi [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] Calling method '>' {{(pid=105885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:16:12.381821 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: INFO nova.api.openstack.requestlog [None req-a7e866fe-ca49-4e2e-a62a-ddaf611eeee7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Sep 23 15:16:12.382225 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: [pid: 105885|app: 0|req: 37/75] 10.222.0.75 () {56 vars in 1074 bytes} [Fri Sep 23 15:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:16:12.601730 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG nova.api.openstack.wsgi [None req-77442ea1-6841-4c4b-8e03-56f8a8f152bf admin admin] Calling method '>' {{(pid=105884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:16:12.605131 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-77442ea1-6841-4c4b-8e03-56f8a8f152bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:16:12.605640 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-77442ea1-6841-4c4b-8e03-56f8a8f152bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:16:12.606068 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-77442ea1-6841-4c4b-8e03-56f8a8f152bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:16:12.606775 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-77442ea1-6841-4c4b-8e03-56f8a8f152bf admin admin] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:16:12.607217 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-77442ea1-6841-4c4b-8e03-56f8a8f152bf admin admin] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:16:12.607626 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: DEBUG oslo_concurrency.lockutils [None req-77442ea1-6841-4c4b-8e03-56f8a8f152bf admin admin] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:16:12.630478 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: INFO nova.api.openstack.requestlog [None req-77442ea1-6841-4c4b-8e03-56f8a8f152bf admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.094124 Sep 23 15:16:12.631928 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: [pid: 105884|app: 0|req: 39/76] 10.222.0.75 () {60 vars in 1193 bytes} [Fri Sep 23 15:16:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:17:11.064582 dv-cinder-855013-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 23 15:17:11.065460 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: Fri Sep 23 15:17:11 2022 - graceful shutdown triggered... Sep 23 15:17:11.065932 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: Gracefully killing worker 2 (pid: 105885)... Sep 23 15:17:11.066294 dv-cinder-855013-3-iscsi devstack@n-api.service[105884]: Gracefully killing worker 1 (pid: 105884)... Sep 23 15:17:11.216744 dv-cinder-855013-3-iscsi devstack@n-api.service[105885]: DEBUG dbcounter [-] [105885] Writing DB stats nova_api:SELECT=4 {{(pid=105885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:12.065094 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: worker 1 buried after 1 seconds Sep 23 15:17:12.065094 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: worker 2 buried after 1 seconds Sep 23 15:17:12.065094 dv-cinder-855013-3-iscsi devstack@n-api.service[105883]: goodbye to uWSGI. Sep 23 15:17:12.067822 dv-cinder-855013-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 23 15:17:12.068827 dv-cinder-855013-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 23 15:17:12.073140 dv-cinder-855013-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 15:17:12.085689 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 15:17:12 2022] *** Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: nodename: dv-cinder-855013-3-iscsi Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: machine: x86_64 Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: clock source: unix Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: pcre jit disabled Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: detected number of CPU cores: 4 Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: current working directory: / Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: detected binary path: /usr/bin/uwsgi-core Sep 23 15:17:12.087723 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: your processes number limit is 47680 Sep 23 15:17:12.088570 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: your memory page size is 4096 bytes Sep 23 15:17:12.088570 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: detected max file descriptor number: 2048 Sep 23 15:17:12.088570 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: lock engine: pthread robust mutexes Sep 23 15:17:12.088570 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: thunder lock: enabled Sep 23 15:17:12.088570 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 15:17:12.088570 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 15:17:12.141253 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: Python main interpreter initialized at 0x55f745ff89c0 Sep 23 15:17:12.141253 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: python threads support enabled Sep 23 15:17:12.141253 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: your server socket listen backlog is limited to 100 connections Sep 23 15:17:12.141253 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: your mercy for graceful operations on workers is 90 seconds Sep 23 15:17:12.141696 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 15:17:12.141696 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: *** Operational MODE: preforking *** Sep 23 15:17:12.142056 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: *** uWSGI is running in multiple interpreter mode *** Sep 23 15:17:12.142056 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: spawned uWSGI master process (pid: 120903) Sep 23 15:17:12.142272 dv-cinder-855013-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 15:17:12.155977 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: spawned uWSGI worker 1 (pid: 120918, cores: 1) Sep 23 15:17:12.155977 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: spawned uWSGI worker 2 (pid: 120919, cores: 1) Sep 23 15:17:12.155977 dv-cinder-855013-3-iscsi devstack@n-api.service[120903]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 15:17:12.810334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 15:17:12.837336 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 15:17:13.967208 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:17:13.967208 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: from cryptography.utils import int_from_bytes Sep 23 15:17:13.972130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:17:13.972130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: from cryptography.utils import int_from_bytes Sep 23 15:17:14.016572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:17:14.016572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: from cryptography.utils import int_from_bytes Sep 23 15:17:14.017200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:17:14.017200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: from cryptography.utils import int_from_bytes Sep 23 15:17:16.367658 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:17:16.368223 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:17:16.368505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:17:16.368842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:17:16.369063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:17:16.369481 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.369806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.370128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.370444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.370751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.371081 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.371396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.371713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.372517 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.372844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.373300 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855013-3-iscsi {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.373641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.373934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.374251 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.374571 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.374881 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.375576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.375919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.376508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.377173 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.377656 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.378159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.378696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.379745 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.379745 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.379745 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.380461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.380461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.382234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.382234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855013-3-iscsi {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.382234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.382234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.382234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.383278 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.383278 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.383278 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.384511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.384511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.384511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.384511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.385442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.385442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.385442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.386019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.386019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.386365 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.386528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.386723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.387199 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.387602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.388058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.388528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.389049 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.389378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.389672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.390070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.390399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.390724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.391035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.391342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.391646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.391952 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.392999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.392999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.392999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.393437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.393697 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.394013 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.394335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.394642 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.394963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.395392 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.395642 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.395949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.396290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.396641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.396956 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.397657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.397657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.397961 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.398327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.398483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.398767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.399091 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.399396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.399643 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.399943 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.400245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.400560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.400911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.401216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.401520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.401818 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.402297 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.402768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.403225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.403695 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.406061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.406061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.406061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.406061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.406061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.406061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.406061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.407184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.407184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.407184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.408135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.408837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.409327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.409792 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.410241 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.410712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.411161 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.411626 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.412099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.412547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.413042 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.413532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.414012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.414487 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.414961 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.415454 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.415917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.416409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.416919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.417401 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.417863 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.418330 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.418789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.419267 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.419775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.420259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.420769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.421238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.421734 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.422236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.422751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.423250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.423976 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.424484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.425007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.425529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.426009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.426528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.427041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.427565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.428078 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.428618 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.429136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.429665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.430181 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.430722 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.431243 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.431768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.432302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.432860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.433354 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.433912 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.434435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.434951 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.435495 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.436027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.436549 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.437094 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.437625 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.438136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.438637 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.439145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.439731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.440241 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.440787 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.441293 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.441775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.442299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.442783 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.443265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.443759 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.444257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.444798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.445324 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.445849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.446353 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.446874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.447368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.447857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.448335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.448869 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.449386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.449873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.450366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.450851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.451338 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.451816 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.452341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.452880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.453391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.453922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.454413 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.454972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.455498 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.456005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.456504 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.457063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.457558 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.458075 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.458631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.459127 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.459618 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.460114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.460638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.461153 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.461657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.462157 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.462650 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.463142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.463634 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.464165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.464717 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.465218 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.465740 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.466263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.466750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.467291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.467797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.468309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.468829 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.469331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.469813 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.470307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.470812 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.471301 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.471805 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.472307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.472871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.473397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.473922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.474458 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.475006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.475522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.476056 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.476576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.477187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.477717 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.478280 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.478835 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.479381 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.479922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.480452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.481001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.481519 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.482146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.482680 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.483198 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.483748 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.484290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.484980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.485871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.486656 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.487514 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.488042 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.488566 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.489112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.489693 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.490262 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.490793 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.491331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.491847 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.492368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.492938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.493454 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.494041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.494567 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.495100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.495616 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.496158 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.496731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.497289 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.497803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.498342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.498851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.499383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.499922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.500461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.501028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.501559 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.502270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.502806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.503322 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.503872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.504384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.504930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.505474 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.506013 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.506538 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.507069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.507588 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.508105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.508656 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.509181 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.509703 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.510234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.510798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.511324 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.511870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.512397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.512946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.513476 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.514025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.514539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.515059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.515582 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.516093 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.516697 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.517230 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.517971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.518506 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.519046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.519581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.520112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.520677 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.521211 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.521770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.522289 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.522804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.523322 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.523850 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.524379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.524988 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.525523 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.526051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.526577 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.527092 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.527598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.528136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.528708 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.529519 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.530077 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.530597 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.531125 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.531705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.532237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.532832 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.533423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.533951 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.534479 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.535008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.535526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.536041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.536568 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.537112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.537636 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.538144 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.538685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.539246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.539832 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.540343 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.540912 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.541458 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.541968 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.542505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.543025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.543570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.544112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.544772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.545299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.545849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.546404 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.546935 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.547490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.548027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.548689 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.549236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.549756 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.550302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.550823 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.551330 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.551854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.552403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.552947 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.553472 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.554001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.554514 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.555055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.556110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.556672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.557206 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.557589 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.560630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.560630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.560630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.560630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.560630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.560630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.560630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.560630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.561219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.561219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.561219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.561423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.561882 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.562263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.562517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:17:16.562948 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.563034 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:17:16.563121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.563333 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:17:16.563432 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.563707 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:17:16.563824 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.563967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:17:16.564080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.564526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.564897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.565002 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.565231 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.565430 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.565663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.565873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.566013 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.566312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.566709 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.567100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.567479 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.567855 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.568233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.568635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.568892 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.569024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.569245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.569442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.569593 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.569873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.569992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.570260 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.570364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.570533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.570630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.570859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.571064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.571355 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855013-3-iscsi {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.571689 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.571974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.572090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.572308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.572876 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.573087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.573212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.573511 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.573824 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.574064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.574350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.574665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.574977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.575137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.575279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.575625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.575937 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.576159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.576273 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.576561 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.576971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.577098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.577425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.577737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.578003 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.578158 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855013-3-iscsi {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.578463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.578776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.579020 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.579128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.579496 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.579833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.580277 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.580445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.581080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.581212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.581551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.581867 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.582097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.582204 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.582513 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.582836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.583048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.583170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.583452 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.583764 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.584032 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.584139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.584395 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.584727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.585017 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.585122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.585271 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.585583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.585908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.586137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.586256 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.586541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.586793 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.587044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.587282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.587388 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.587671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.587978 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.588253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.588372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.588577 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.588951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.589262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.589436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.589591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.589863 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.590169 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.590486 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.590716 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.590823 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.591107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.591412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.591720 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.591831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.592150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.592400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.592730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.592954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.593052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.593379 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.593687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.593977 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.594078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.594319 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.594625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.594932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.595179 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.595279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.595572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.596039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.596490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.596793 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.596907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.597157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.597467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.597777 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.598050 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.598150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.598394 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.598702 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.599006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.599257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.599358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.599601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.599907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.600212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.600482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.600582 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.600833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.601138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.601443 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.601714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.601823 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.602038 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.602340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.602659 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.602913 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.603028 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.603271 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.603578 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.603884 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.604143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.604243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.604500 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.604830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.605134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.605396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.605504 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.605748 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.606054 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.606372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.606598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.606710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.606966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.607282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.607580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.607805 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.607913 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.608185 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.608490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.608830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.609055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.609154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.609423 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.609726 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.610029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.610280 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.610388 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.610619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.610919 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.611335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.611498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.612343 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.612446 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.612792 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.613103 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.613382 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.613482 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.613720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:17:16.614063 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.614387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.614500 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.614737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.615053 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.615389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.615590 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.615700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.616027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.616227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.616332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.616553 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.616941 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.617086 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.617272 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.617384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.617592 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.617691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.617904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.618088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.618236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.618337 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.618531 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.618631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.618848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.619010 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.619199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.619490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.619807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.620121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.620329 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.620432 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.620766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.621085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.621410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.621724 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.622071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.622343 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.622455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.622709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.623035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.623361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.623671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.623982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.624217 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.624336 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.624670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.624978 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.625291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.625579 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.625682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.625906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.626229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.626542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.626821 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.626931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.627446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.627799 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.628122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.628377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.628477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.628797 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.629118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.629433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.629544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.629754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.630071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.630391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.630705 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.630949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.631061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.631319 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.631625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.631933 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.632165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.632265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.632539 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.632885 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.633194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.633303 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.633534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.633845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.634182 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.634400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.634508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.634795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.635107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.635420 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.635629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.635727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.636027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.636337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.636644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.636767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.636990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.637301 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.637608 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.637859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.637960 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.638224 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.638531 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.638847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.639084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.639184 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.639455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.639767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.640080 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.640275 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.640430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.640813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.641127 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.641349 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.641458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.641781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.642088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.642444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.642557 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.643082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.643466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.643790 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.644070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.644181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.644397 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.644745 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.645056 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.645338 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.645439 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.645666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.645971 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.646282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.646591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.646882 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.646984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.647192 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.647518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.647828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.648080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.648181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.648423 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.648751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.649098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.649343 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.649456 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.649741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.650080 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.650400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.650684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.650787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.651024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.651342 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.651654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.651918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.652019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.652266 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.652578 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.652925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.653027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.653239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.653563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.656492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.656492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.656492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.656492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.656492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.656492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.656492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.656492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.657086 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.657086 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.657086 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.657286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.657577 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.657969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.658233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.658509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.659004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.659204 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.659527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.659632 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.659840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.660113 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.660208 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.660456 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.660719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.660836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.661104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.661290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.661425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.661734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.661875 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.662048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.662382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.662483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.662717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.662949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.663051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.663328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.663518 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.663651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.663963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.664055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.664275 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.664597 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.664895 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.664990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.665208 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.665522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.665640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.665825 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.666030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.666132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.666429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.666601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.666735 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.667048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.667299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.667400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.667650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.667873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.667967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.668249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.668428 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.668570 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.668918 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.669033 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.669239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.669512 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.669630 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.669857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.670082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.670176 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.670473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.670657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.670803 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.671074 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.671167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.671430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.671643 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.671739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.672014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.672206 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.672344 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.672671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.672797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.672988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.673272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.673373 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.674194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.674291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.674291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.674654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.674826 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.674930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.675251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.675343 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.675577 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.675826 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.675946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.676240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.676387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.676557 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.676914 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.677018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.677232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.677499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.677592 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.677858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.678062 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.678164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.678466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.678623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.678778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.679098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.679214 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.679393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.679656 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.679750 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.680156 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.680297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.683146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.683287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.683398 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.683489 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.683584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.683671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.683671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.684436 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.684436 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.684629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.684732 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.684820 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.684905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.684998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.685093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.685186 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.685285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.685379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.685465 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.685465 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.685465 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.686979 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.687079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.687166 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.687251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.687251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.687251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.687251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.688196 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.688284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.688374 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.688459 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.688550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.689492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.689492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.689866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.689969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.689969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.690132 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.690219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.690219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.690219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.690219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.691752 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.691840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.691939 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692026 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692117 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692117 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692117 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692649 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.692829 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.694671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.694789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.694888 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.694975 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695426 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695711 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.695835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.696752 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.696868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.696951 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697351 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697430 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697501 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697585 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697658 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697729 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.697965 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698049 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698261 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698557 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698633 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698780 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.698865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.699007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.699086 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.701456 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.701575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.701687 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.701783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.701881 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.701972 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702581 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.702937 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703217 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703660 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.703852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.704701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.704940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705514 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705666 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705745 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705816 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705919 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.705995 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706086 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706172 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706320 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706398 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706470 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706539 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706762 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706833 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706902 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.706979 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707215 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707286 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707363 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.707672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709053 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709172 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709254 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709327 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709623 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.709694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.710386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.710494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.710494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.710637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.710708 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.710789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.711306 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.711431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.711520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.711600 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.711672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.712032 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.712132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.712216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.712438 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.712773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.713101 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.713196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.713423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.713539 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.713745 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.713841 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.714078 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.714182 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.714387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.714497 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.714701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.714796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.715015 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.715111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.715325 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.715435 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.715631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.715787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.715944 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.716092 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.716247 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.716401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.716548 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.716736 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.716907 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.717121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.717293 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.717441 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.717730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.718080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.718398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.718559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.718717 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.719034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.719186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.719342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.719507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.719671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.719833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.719990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.720139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.720286 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.720499 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.720782 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.721057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.721448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.721620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.721795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.722033 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.722308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.722554 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.722813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.722974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.723156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.723317 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.723480 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.723635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.723791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.723939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.724086 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.724235 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.724395 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.724563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.724790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.724948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.725102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.725263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.725413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.725560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.725707 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.725861 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.726018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.726180 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.726337 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.726485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.726644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.726798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.726946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.727102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.727251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.727398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.727545 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.727692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.727847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.728010 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.728159 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.728305 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.728523 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.728715 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.728875 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.729030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.729188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.729335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.729491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.729639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.729800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.729954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.730111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.730265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.730412 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.730576 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.730751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.730975 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.731127 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.731274 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.731439 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.731723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.731931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.732090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.732245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.732495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.732495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.732823 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.732993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.733141 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.733297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.733452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.733640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.733799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.733957 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.734114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.734261 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.734407 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.734554 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.734716 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.734865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.735030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.735186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.735336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.735491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.735653 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.735815 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.735963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.736196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.736358 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.736522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.737160 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.737160 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.737475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.737630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.737630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.737920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.738069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.738224 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.738379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.738526 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.738681 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.738855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.739018 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.739167 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.739314 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.739472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.739702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.739860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.740024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.740172 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.740319 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.740467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.740665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.740827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.741001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.741001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.741377 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.741537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.741834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.741995 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.742153 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.742309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.742457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.742704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.742865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.743029 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.743187 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.743342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.743490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.743646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.743816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.743981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.744183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.744342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.744489 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.744670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.744840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.744996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.745151 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.745307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.745461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.745625 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.745792 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.745940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.746087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.746242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.746404 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.746559 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.746707 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.746854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.747008 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.747162 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.747391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.747550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.747706 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.747864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.748010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.748157 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.748324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.748324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.748655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.748812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.748959 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.749105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.749269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.749426 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.749574 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.749743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.749897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.750056 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.750204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.750358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.750505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.750653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.750800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.750955 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.751103 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.751334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.751496 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.751496 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.751960 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.752128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.752278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.752425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.752580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.752854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.753009 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.753169 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.753324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.753479 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.753479 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.753777 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.753934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.754098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.754245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.754245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.754535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.754692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.754849 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.755005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.755230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.755382 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.755537 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.755685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.755844 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.756000 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.756165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.756329 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.756484 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.756662 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.756824 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.756978 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.757126 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.757280 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.757434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.757594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.757744 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.757899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.758064 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.758212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.758366 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.758522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.758670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.758823 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.758981 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.759129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.759282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.759442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.759590 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.759736 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.759901 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.760065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.760221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.760376 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.760523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.760692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.760850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.760850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.761140 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.761140 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.761516 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.761678 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.761836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.761836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.762283 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.762440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.762588 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.762743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.763277 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.763277 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.763588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.763588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.763885 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.764035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.764189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.764350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.764508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.764766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.764922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.765080 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.765236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.765393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.765541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.765696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.765851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.765851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.766147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.766147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.766455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.766614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.766769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.766917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.767064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.767232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.767523 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.767696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.767844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.767844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.768144 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.768307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.768456 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.768646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.768815 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.769046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.769207 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.769357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.769357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.769644 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.769798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.769798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.770111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.770267 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.770422 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.770570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.770741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.770898 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.771047 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.771200 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.771356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.771741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.771936 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.771936 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.772389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.772541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.772712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.772861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.773047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.773293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.773446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.773446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.773743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.773905 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:17:16.774071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.774071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.774071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.774071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.774071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.774071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.774071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.775120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.775120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.775120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.775120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.775120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.775810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.775810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.776104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.776258 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.776464 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.777130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.777460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.777788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.779042 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.779483 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.779752 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.780286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.780869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.781868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.782368 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.782985 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.783575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.784163 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.784802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.785374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.785984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.786547 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.787143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.787736 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.788307 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.788900 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.789513 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.790090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.790678 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.791279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.791803 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.792434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.793008 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.793347 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.793787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.794028 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.794407 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.794677 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.795012 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.795328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.795649 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.795976 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.796293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.796631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.796950 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.797269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.797586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.797896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.798217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.798509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.799116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.799839 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.800163 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.800481 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.800843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.801157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.801470 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.801784 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.802095 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.802415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.802722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.803145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.803455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.803780 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.804132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.804448 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.804782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.805112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.805421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.805729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.806051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.806362 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.806692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.807014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.807327 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.807682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.807998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.808540 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.808918 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.809238 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.809575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.809909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.810220 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.810531 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.810936 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.811165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.811478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.811793 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.812107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.812419 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.812754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.813068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.813380 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.813691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.814004 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.814458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.815023 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.815405 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.815720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.816032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.816350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.816745 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.817073 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.817395 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.817718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.818827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.819160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.819479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.819796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.820111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.820433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.820794 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.821113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.821420 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.822267 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.822267 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.822480 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.822802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.823115 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.823439 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.823767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.824077 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.824422 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.824802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.825081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.825424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.825753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.826076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.826388 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.827477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.827789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.828107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.828431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.828778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.829087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.829394 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.829704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.830573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.830905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.831224 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.831539 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.831856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.832166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.832473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.832808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.833116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.833420 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.833723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.834033 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.834337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.834644 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.834956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.835245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.835420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO dbcounter [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Registered counter for database nova_api Sep 23 15:17:16.835535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.835865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.836206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.836520 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.836877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.837187 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.837511 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.837821 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.838142 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.838468 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.838789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.839096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.839430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.839739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.840049 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.840360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.840691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.841002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.841356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.841637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.841963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.842269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.842593 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.842909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.843226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.843539 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.843848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.844183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.844490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.844828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.845137 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.845589 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.846498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.846828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.847153 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.847475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.847795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.848113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.848440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.848793 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.849109 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.849438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.849766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.850115 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.850431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.851110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.851738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.852067 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.852387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.852718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:17:16.852968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:17:16.856255 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_db.sqlalchemy.engines [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:17:16.863683 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writer thread running {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:17:16.915782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO dbcounter [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Registered counter for database nova_api Sep 23 15:17:16.920091 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.context [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e080b19-aa0c-4000-9579-fc774adbca9b(cell1) {{(pid=120919) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 15:17:16.924239 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:17:16.924737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:17:16.926353 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:17:16.927078 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:17:16.927514 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:17:16.929537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:17:16.931583 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO dbcounter [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Registered counter for database nova_cell0 Sep 23 15:17:16.935642 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO dbcounter [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Registered counter for database nova_cell1 Sep 23 15:17:16.937154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_db.sqlalchemy.engines [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:17:16.942871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_db.sqlalchemy.engines [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:17:16.944212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_db.sqlalchemy.engines [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:17:16.944833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writer thread running {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:17:16.950692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writer thread running {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:17:16.952733 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writer thread running {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:17:17.003883 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.context [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5e080b19-aa0c-4000-9579-fc774adbca9b(cell1) {{(pid=120918) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 15:17:17.007876 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:17:17.008349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:17:17.009956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:17:17.010695 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:17:17.011143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:17:17.013201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:17:17.015255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO dbcounter [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Registered counter for database nova_cell0 Sep 23 15:17:17.019796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO dbcounter [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Registered counter for database nova_cell1 Sep 23 15:17:17.027687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_db.sqlalchemy.engines [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:17:17.029505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_db.sqlalchemy.engines [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:17:17.036324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writer thread running {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:17:17.038556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writer thread running {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:17:17.097588 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO dbcounter [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Registered counter for database nova_cell0 Sep 23 15:17:17.104965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_db.sqlalchemy.engines [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:17:17.110986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writer thread running {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:17:17.189092 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO dbcounter [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Registered counter for database nova_cell0 Sep 23 15:17:17.196700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_db.sqlalchemy.engines [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:17:17.201556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writer thread running {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:17:17.429524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: WARNING keystonemiddleware.auth_token [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:17:17.437120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: WARNING keystonemiddleware.auth_token [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:17:17.516723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: WARNING keystonemiddleware.auth_token [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:17:17.524180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: WARNING keystonemiddleware.auth_token [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:17:17.789756 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: WARNING keystonemiddleware.auth_token [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:17:17.795950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: WARNING keystonemiddleware.auth_token [None req-ad24fe25-9cd6-4c9e-8d8f-bcaa52ab5ae1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:17:17.801998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f745ff89c0 pid: 120919 (default app) Sep 23 15:17:17.874070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: WARNING keystonemiddleware.auth_token [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 15:17:17.880188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: WARNING keystonemiddleware.auth_token [None req-337c6da4-34fd-42cc-83e5-f28cb9ea1f25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 15:17:17.885553 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f745ff89c0 pid: 120918 (default app) Sep 23 15:17:54.114139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:54.115087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:54.117227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:54.118414 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:55.841499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-629436a1-8260-441d-b7db-a744624e2b1c tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Action: 'create', calling method: .version_select at 0x7fbb03f21430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-514237508", "metadata": {"Type": "work"}}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-629436a1-8260-441d-b7db-a744624e2b1c tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Request method failure captured: Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 121 Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc4iV3-7WIJ9A9WqqfhyicnzoVa20o61R96ee31qT2PZ4LVnjpWTUEs2oz9mSZOrnNrzcDJnrdP4zFwJz6r03s12ax74lfeBRsv-tmw0A-fxKBhfnXroyr3OCABp96BzchqVpwga9o3hSxd_eSk5q1UTn_MNT48MjSbBa4AzJJ22sIA Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:17:55.851842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}] Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 811321b5291b4b8f97f0a047805a1d8d Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-514237508", "metadata": {"Type": "work"}}} Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: Sep 23 15:17:55.857600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-514237508', 'metadata': {'Type': 'work'}}}} Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise error Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi '#$%' Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:17:55.858547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 15:17:55.859973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 15:17:55.863680 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 15:17:55.863680 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:55.865262 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-629436a1-8260-441d-b7db-a744624e2b1c tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:17:55.866571 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-629436a1-8260-441d-b7db-a744624e2b1c tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.759009 Sep 23 15:17:55.867354 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1156 bytes} [Fri Sep 23 15:17:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1761 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:17:55.882026 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:55.883148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:55.884146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:55.884937 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:17:56.428947 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-22a7e8d0-9ca2-488b-ba91-aaea05033caa tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Action: 'create', calling method: .version_select at 0x7fbb03fd5f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-824544537", "metadata": {"Type": "work"}}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-22a7e8d0-9ca2-488b-ba91-aaea05033caa tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Request method failure captured: Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 119 Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4iV3-7WIJ9A9WqqfhyicnzoVa20o61R96ee31qT2PZ4LVnjpWTUEs2oz9mSZOrnNrzcDJnrdP4zFwJz6r03s12ax74lfeBRsv-tmw0A-fxKBhfnXroyr3OCABp96BzchqVpwga9o3hSxd_eSk5q1UTn_MNT48MjSbBa4AzJJ22sIA Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:17:56.458190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}] Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 811321b5291b4b8f97f0a047805a1d8d Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-824544537", "metadata": {"Type": "work"}}} Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: Sep 23 15:17:56.459846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-824544537', 'metadata': {'Type': 'work'}}}} Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise error Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi '0' Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:17:56.460754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 15:17:56.463131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 15:17:56.464795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 15:17:56.464795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.464795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-22a7e8d0-9ca2-488b-ba91-aaea05033caa tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:17:56.464795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-22a7e8d0-9ca2-488b-ba91-aaea05033caa tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.587020 Sep 23 15:17:56.471584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 1/2] 10.222.0.75 () {60 vars in 1156 bytes} [Fri Sep 23 15:17:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 598 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 15:17:56.478681 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-88741195-898e-418c-b19c-0251e97f8055 tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Action: 'create', calling method: .version_select at 0x7fbb03f21d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1471585029", "metadata": {"Type": "work"}}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-88741195-898e-418c-b19c-0251e97f8055 tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Request method failure captured: Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 119 Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc4iV3-7WIJ9A9WqqfhyicnzoVa20o61R96ee31qT2PZ4LVnjpWTUEs2oz9mSZOrnNrzcDJnrdP4zFwJz6r03s12ax74lfeBRsv-tmw0A-fxKBhfnXroyr3OCABp96BzchqVpwga9o3hSxd_eSk5q1UTn_MNT48MjSbBa4AzJJ22sIA Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:17:56.492246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}] Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 811321b5291b4b8f97f0a047805a1d8d Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1471585029", "metadata": {"Type": "work"}}} Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: Sep 23 15:17:56.493856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1471585029', 'metadata': {'Type': 'work'}}}} Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise error Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi '' Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:17:56.495069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 15:17:56.496718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 15:17:56.498142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 15:17:56.498142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:56.500876 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-88741195-898e-418c-b19c-0251e97f8055 tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:17:56.515654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-88741195-898e-418c-b19c-0251e97f8055 tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029449 Sep 23 15:17:56.521726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 2/3] 10.222.0.75 () {60 vars in 1156 bytes} [Fri Sep 23 15:17:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:17:56.543680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-617dc458-6f29-4f64-b94f-12b0aa45896d tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Calling method '.version_select at 0x7fbb03f7f8b0>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:17:58.040554 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-617dc458-6f29-4f64-b94f-12b0aa45896d tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] HTTP exception thrown: Volume tempest-invalid-336502570 could not be found. Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-617dc458-6f29-4f64-b94f-12b0aa45896d tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Request method failure captured: Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-336502570 HTTP/1.1 Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4iV3-7WIJ9A9WqqfhyicnzoVa20o61R96ee31qT2PZ4LVnjpWTUEs2oz9mSZOrnNrzcDJnrdP4zFwJz6r03s12ax74lfeBRsv-tmw0A-fxKBhfnXroyr3OCABp96BzchqVpwga9o3hSxd_eSk5q1UTn_MNT48MjSbBa4AzJJ22sIA Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:17:58.044620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}] Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 811321b5291b4b8f97f0a047805a1d8d Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Volume tempest-invalid-336502570 could not be found. Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'tempest-invalid-336502570'} Sep 23 15:17:58.045747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-336502570 could not be found. (HTTP 404) (Request-ID: req-ce1f0480-19d1-47ba-abea-35ecd8db6ef6) Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:58.046383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:17:58.047314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-336502570 could not be found. Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:17:58.048118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-336502570 could not be found. Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-336502570 could not be found. Sep 23 15:17:58.049065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:58.050510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-617dc458-6f29-4f64-b94f-12b0aa45896d tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Returning 404 to user: Volume tempest-invalid-336502570 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:17:58.051554 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-617dc458-6f29-4f64-b94f-12b0aa45896d tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-336502570" status: 404 len: 98 microversion: 2.1 time: 1.522088 Sep 23 15:17:58.052351 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1215 bytes} [Fri Sep 23 15:17:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-336502570 => generated 98 bytes in 1524 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 15:17:58.066067 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-58383aad-64b1-4f83-8850-ad27380c8d43 tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007407 Sep 23 15:17:58.068623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 3/5] 10.222.0.75 () {58 vars in 1140 bytes} [Fri Sep 23 15:17:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 15:17:58.083353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3f0b1dfa-1f95-4bc5-8431-7ead02a62342 tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006441 Sep 23 15:17:58.084438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 3/6] 10.222.0.75 () {58 vars in 1137 bytes} [Fri Sep 23 15:17:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 15:17:58.101359 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8edab325-5e0c-472b-9b4f-aba9f438613a tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Calling method '.version_select at 0x7fbb03ddd3a0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:17:59.045059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-8edab325-5e0c-472b-9b4f-aba9f438613a tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] HTTP exception thrown: Volume ff39c8ea-6235-4dd1-a8c2-5d2240088623 could not be found. Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8edab325-5e0c-472b-9b4f-aba9f438613a tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Request method failure captured: Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: DELETE /compute/v2.1/os-volumes/ff39c8ea-6235-4dd1-a8c2-5d2240088623 HTTP/1.1 Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc4iV3-7WIJ9A9WqqfhyicnzoVa20o61R96ee31qT2PZ4LVnjpWTUEs2oz9mSZOrnNrzcDJnrdP4zFwJz6r03s12ax74lfeBRsv-tmw0A-fxKBhfnXroyr3OCABp96BzchqVpwga9o3hSxd_eSk5q1UTn_MNT48MjSbBa4AzJJ22sIA Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:17:59.052129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}] Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 811321b5291b4b8f97f0a047805a1d8d Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Volume ff39c8ea-6235-4dd1-a8c2-5d2240088623 could not be found. Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'ff39c8ea-6235-4dd1-a8c2-5d2240088623'} Sep 23 15:17:59.053399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff39c8ea-6235-4dd1-a8c2-5d2240088623 could not be found. (HTTP 404) (Request-ID: req-d692c052-3779-4310-b409-01e0ce27f596) Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:59.054220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:17:59.055250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff39c8ea-6235-4dd1-a8c2-5d2240088623 could not be found. Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 15:17:59.056290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff39c8ea-6235-4dd1-a8c2-5d2240088623 could not be found. Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff39c8ea-6235-4dd1-a8c2-5d2240088623 could not be found. Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.057390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8edab325-5e0c-472b-9b4f-aba9f438613a tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Returning 404 to user: Volume ff39c8ea-6235-4dd1-a8c2-5d2240088623 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:17:59.058197 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8edab325-5e0c-472b-9b4f-aba9f438613a tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/ff39c8ea-6235-4dd1-a8c2-5d2240088623" status: 404 len: 109 microversion: 2.1 time: 0.960179 Sep 23 15:17:59.059477 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:17:58 2022] DELETE /compute/v2.1/os-volumes/ff39c8ea-6235-4dd1-a8c2-5d2240088623 => generated 109 bytes in 965 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:17:59.070556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d71770ed-3bab-4c78-b253-622c126506dc tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Calling method '.version_select at 0x7fbb03d5faf0>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:17:59.154769 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-d71770ed-3bab-4c78-b253-622c126506dc tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] HTTP exception thrown: Volume 79284204-f171-46b3-9caa-b56352beb4f0 could not be found. Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d71770ed-3bab-4c78-b253-622c126506dc tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Request method failure captured: Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/os-volumes/79284204-f171-46b3-9caa-b56352beb4f0 HTTP/1.1 Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4iV3-7WIJ9A9WqqfhyicnzoVa20o61R96ee31qT2PZ4LVnjpWTUEs2oz9mSZOrnNrzcDJnrdP4zFwJz6r03s12ax74lfeBRsv-tmw0A-fxKBhfnXroyr3OCABp96BzchqVpwga9o3hSxd_eSk5q1UTn_MNT48MjSbBa4AzJJ22sIA Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:17:59.157476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f3f04aa2dcf84d32bcf7c8cebf64feee"}]}] Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: f3f04aa2dcf84d32bcf7c8cebf64feee Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesNegativeTest-479702012 Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 811321b5291b4b8f97f0a047805a1d8d Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesNegativeTest-479702012-project Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Volume 79284204-f171-46b3-9caa-b56352beb4f0 could not be found. Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '79284204-f171-46b3-9caa-b56352beb4f0'} Sep 23 15:17:59.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79284204-f171-46b3-9caa-b56352beb4f0 could not be found. (HTTP 404) (Request-ID: req-228489c9-41d4-4a70-b9c1-688f3adceff3) Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:59.160357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:17:59.171140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79284204-f171-46b3-9caa-b56352beb4f0 could not be found. Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 15:17:59.172551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79284204-f171-46b3-9caa-b56352beb4f0 could not be found. Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79284204-f171-46b3-9caa-b56352beb4f0 could not be found. Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d71770ed-3bab-4c78-b253-622c126506dc tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] Returning 404 to user: Volume 79284204-f171-46b3-9caa-b56352beb4f0 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d71770ed-3bab-4c78-b253-622c126506dc tempest-VolumesNegativeTest-479702012 tempest-VolumesNegativeTest-479702012-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/79284204-f171-46b3-9caa-b56352beb4f0" status: 404 len: 109 microversion: 2.1 time: 0.094066 Sep 23 15:17:59.173710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:17:59 2022] GET /compute/v2.1/os-volumes/79284204-f171-46b3-9caa-b56352beb4f0 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:18:08.229525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1591082245", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:08.510572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] validate_networks() for [('d3ffbd85-3b9b-417b-b45f-55b60c247ef0', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:18:12.088092 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-10559626-f015-45d1-9a77-93a1765d6c61 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'create', calling method: .version_select at 0x7fbb03dfc550>, body: {"keypair": {"name": "tempest-keypair-2024836056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAsMBznPFO13oUsbSMkiCpCl4LTLAXNdWUUEVjjiBxS0PjYda2cgjxeC04E60FS2zCn/MadmFR5Gk7nMAuPLl6AYgfa35uHTWiNkGcpcwXxZT1QRCRb8BNaumoY6LdZ3Q=="}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:12.162476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-10559626-f015-45d1-9a77-93a1765d6c61 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Getting quotas for project bb9f84f2d16a4389a4be567cd2be3a8a. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:18:12.172079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-10559626-f015-45d1-9a77-93a1765d6c61 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Getting quotas for user e38b853b47b64567b00092eb32201b4d and project bb9f84f2d16a4389a4be567cd2be3a8a. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:18:12.260738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-10559626-f015-45d1-9a77-93a1765d6c61 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.981812 Sep 23 15:18:12.261560 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 5/9] 10.222.0.75 () {62 vars in 1200 bytes} [Fri Sep 23 15:18:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 984 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 23 15:18:12.559644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:18:12.560718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:18:12.561346 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:18:12.561901 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:18:12.562460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:18:12.608610 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:12.609437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:12.610535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:12.616029 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:12.617480 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:12.617806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:12.721112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Getting quotas for project 1abe4f1508864f77b30c4c635c368f02. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:18:12.742442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Getting quotas for user 4cfac62e1c304167abb971815d5da358 and project 1abe4f1508864f77b30c4c635c368f02. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:18:12.779651 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:18:12.785682 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:18:12.973665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f46104d3-dcf6-4a73-8c08-5f959f4ff808 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.478648 Sep 23 15:18:12.975970 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 5/10] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:18:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 5482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:18:12.987994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-33ef4f1d-407c-4fed-a433-e2fff8cce148 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:12.989116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-33ef4f1d-407c-4fed-a433-e2fff8cce148 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:13.247052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-33ef4f1d-407c-4fed-a433-e2fff8cce148 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:13.303870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1565217729", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "networks": [{"uuid": "40d84ac8-df74-4849-8e65-19da5d7d6642"}]}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:13.306479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-33ef4f1d-407c-4fed-a433-e2fff8cce148 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1222 microversion: 2.1 time: 0.320304 Sep 23 15:18:13.319949 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 6/11] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:12 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1222 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:13.420913 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] validate_networks() for [('40d84ac8-df74-4849-8e65-19da5d7d6642', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:18:13.653278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-503651410", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:13.786191 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] validate_networks() for [('d3ffbd85-3b9b-417b-b45f-55b60c247ef0', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:18:15.420754 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:18:15.421366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:18:15.421629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:18:15.422191 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:18:15.422758 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:18:15.448058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:15.452781 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:15.454327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:15.455543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:15.456404 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:15.457113 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:15.490544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Getting quotas for project b0f632ecb8ee4e6fb59978560789f599. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:18:15.497699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Getting quotas for user a568b6fd614744abaf5ca41fb26c1f13 and project b0f632ecb8ee4e6fb59978560789f599. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:18:15.519282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:18:15.530327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:18:15.657066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c749bd73-05f7-45ee-9edf-d91aa60b7070 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.545392 Sep 23 15:18:15.660238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 6/12] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:18:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:18:16.059610 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ac542c73-71f0-4b58-bdee-b8e24fdabb45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'create', calling method: .version_select at 0x7fbb03428790>, body: {"keypair": {"name": "tempest-keypair-1788673810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERJtRYMLVANwbmB9yUhenGrNks0oV0Ohi52dsoQaPWjqLvDuqpCROec5gaHv6FSvyLq03nwPEF/eHw/Ks4M0dzRgR4STcL/Xia3LyKTsfMwdFRfd+cGZrxOdrf0USVo7A=="}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:16.169567 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-ac542c73-71f0-4b58-bdee-b8e24fdabb45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Getting quotas for project d4fd7ca907fa4806904e1c00b21b5447. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:18:16.183225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-ac542c73-71f0-4b58-bdee-b8e24fdabb45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Getting quotas for user 4bded8b580f34e08b2890eb3430f4b80 and project d4fd7ca907fa4806904e1c00b21b5447. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:18:16.262273 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ac542c73-71f0-4b58-bdee-b8e24fdabb45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.600405 Sep 23 15:18:16.265447 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 7/13] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:18:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:16.278651 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dc26a386-8840-4891-ac98-f6618eaa9752 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:16.281814 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dc26a386-8840-4891-ac98-f6618eaa9752 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:16.746010 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dc26a386-8840-4891-ac98-f6618eaa9752 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:16.784162 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dc26a386-8840-4891-ac98-f6618eaa9752 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1215 microversion: 2.1 time: 0.516160 Sep 23 15:18:16.788379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 8/14] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:16 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1215 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:17.811353 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-82cf5461-7310-45f1-974f-3e984deda7bd tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:17.820023 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-82cf5461-7310-45f1-974f-3e984deda7bd tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:18.071224 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-82cf5461-7310-45f1-974f-3e984deda7bd tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:18.093799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-82cf5461-7310-45f1-974f-3e984deda7bd tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1215 microversion: 2.1 time: 0.287715 Sep 23 15:18:18.109524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 9/15] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:17 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1215 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:18.507260 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:18:18.508842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:18:18.509591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:18:18.510145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:18:18.510761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:18:18.567660 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:18.575228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:18.578765 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:18.579928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:18.582733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:18.587753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:18.773718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Getting quotas for project 1abe4f1508864f77b30c4c635c368f02. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:18:18.788457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Getting quotas for user 4cfac62e1c304167abb971815d5da358 and project 1abe4f1508864f77b30c4c635c368f02. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:18:18.816275 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:18:18.820896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:18:19.074456 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-27eb1a6b-88eb-4fd1-ab38-ff009485cea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.427423 Sep 23 15:18:19.083771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 7/16] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:18:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 5438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:18:19.087177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9a93aaca-6349-457f-bf2f-ef7a451192fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:19.087890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9a93aaca-6349-457f-bf2f-ef7a451192fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:19.120651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:19.121921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:19.165833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:19.166338 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:19.166783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:19.167507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:19.167958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:19.168386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:20.102094 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:20.176150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9aecc9c2-f348-4e6b-aa3e-76ac8a660a3e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1275 microversion: 2.1 time: 1.044514 Sep 23 15:18:20.183081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 8/17] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:19 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1275 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:20.213913 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-297771929", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16dbf76f-cd6b-4812-a7f7-e2899a0b32a2"}], "security_groups": [{"name": "tempest-securitygroup--567295522"}], "key_name": "tempest-keypair-2024836056", "user_data": "}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:20.286624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9a93aaca-6349-457f-bf2f-ef7a451192fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:20.297827 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9a93aaca-6349-457f-bf2f-ef7a451192fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1221 microversion: 2.1 time: 1.210648 Sep 23 15:18:20.300309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 10/18] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:19 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1221 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:20.541206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] validate_networks() for [('16dbf76f-cd6b-4812-a7f7-e2899a0b32a2', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:18:21.210418 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:21.211378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:21.219328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:21.221065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:21.222020 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:21.222980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:21.223641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:21.224247 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:21.441705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:21.462612 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-66c3b723-5bef-4c28-a7f9-3cd0490e504f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1273 microversion: 2.1 time: 0.255906 Sep 23 15:18:21.484492 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 11/19] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:21 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:21.495694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:21.495944 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:21.504173 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:21.505100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:21.505778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:21.506725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:21.507358 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:21.508935 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:21.588677 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:18:21.589345 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:18:21.589549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:18:21.590124 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:18:21.590682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:18:21.606263 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:21.607013 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:21.609194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:21.610208 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:21.611344 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:21.613440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:21.645607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Getting quotas for project bb9f84f2d16a4389a4be567cd2be3a8a. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:18:21.654005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Getting quotas for user e38b853b47b64567b00092eb32201b4d and project bb9f84f2d16a4389a4be567cd2be3a8a. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:18:21.666229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:18:21.668483 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:18:21.724721 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:21.744634 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5bb5e273-61c2-4ce1-b363-af55023be8e7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1225 microversion: 2.1 time: 0.257506 Sep 23 15:18:21.746766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-012b6af9-081e-40bb-ae62-95cfd92aeaed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.561873 Sep 23 15:18:21.747446 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 9/20] 10.222.0.75 () {62 vars in 1188 bytes} [Fri Sep 23 15:18:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 15:18:21.754911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 12/21] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:21 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1225 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:21.758917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b51edbd3-93c3-44d7-9867-fb1e49823f13 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:21.759526 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b51edbd3-93c3-44d7-9867-fb1e49823f13 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:21.850857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b51edbd3-93c3-44d7-9867-fb1e49823f13 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:21.862102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b51edbd3-93c3-44d7-9867-fb1e49823f13 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:21.864532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b51edbd3-93c3-44d7-9867-fb1e49823f13 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:21.867048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b51edbd3-93c3-44d7-9867-fb1e49823f13 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1281 microversion: 2.20 time: 0.110991 Sep 23 15:18:21.871888 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 10/22] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:21 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:18:22.502548 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:22.504064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:22.525774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:22.527744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:22.529183 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:22.539475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:22.540560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:22.541427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:22.575374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-139243751", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b94c7d0-0c4f-4356-ac0d-a0345dcfe903"}], "security_groups": [{"name": "tempest-securitygroup--1371372601"}], "key_name": "tempest-keypair-1788673810", "user_data": "}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:22.646683 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:22.661344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-590ef619-5528-4797-81fc-0d003db0efab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1273 microversion: 2.1 time: 0.168443 Sep 23 15:18:22.662192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 13/23] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:22 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:22.732022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] validate_networks() for [('2b94c7d0-0c4f-4356-ac0d-a0345dcfe903', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:18:22.780190 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:22.784121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:22.793306 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:22.794930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:22.795877 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:22.796888 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:22.797865 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:22.798742 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:22.889889 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:22.901344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1874d6d4-6dac-4145-a9de-2c52e664540a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1225 microversion: 2.1 time: 0.133217 Sep 23 15:18:22.904640 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 14/24] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:22 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:22.907619 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:22.908772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:22.915698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:22.916190 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:22.916657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:22.917362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:22.917817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:22.918751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:23.005700 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:23.017958 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:23.020795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:23.022526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7cba3361-f3e7-4bbe-b3c4-c2cfddfdf66d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1285 microversion: 2.20 time: 0.118762 Sep 23 15:18:23.023919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 15/25] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:22 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:23.261491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:18:23.261795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:18:23.262334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:18:23.263641 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:18:23.263952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:18:23.283044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:23.284496 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:23.284993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:23.285764 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:23.286283 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:23.286649 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:23.321803 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Getting quotas for project d4fd7ca907fa4806904e1c00b21b5447. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:18:23.331391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Getting quotas for user 4bded8b580f34e08b2890eb3430f4b80 and project d4fd7ca907fa4806904e1c00b21b5447. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:18:23.356926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:18:23.361057 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:18:23.438871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7d5a14df-49a8-4d80-9732-c5d9386b12b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.867867 Sep 23 15:18:23.441012 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 11/26] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:18:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 15:18:23.453016 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-be99c553-2530-4271-9384-e35ecc62c5dc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:23.453765 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-be99c553-2530-4271-9384-e35ecc62c5dc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:23.539963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-be99c553-2530-4271-9384-e35ecc62c5dc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:23.555030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-be99c553-2530-4271-9384-e35ecc62c5dc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1237 microversion: 2.1 time: 0.103645 Sep 23 15:18:23.555730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 16/27] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:23 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:23.687839 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:23.688850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:23.700149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:23.701148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:23.701976 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:23.703229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:23.703881 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:23.704377 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:23.782994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:23.816129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-49a05244-634f-41be-a423-810000164aae tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1273 microversion: 2.1 time: 0.123211 Sep 23 15:18:23.818564 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 12/28] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:23 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:23.929806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:23.930426 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:23.942526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:23.943030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:23.943469 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:23.944182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:23.944664 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:23.945090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:24.036413 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:24.049272 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:24.049940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:24.055435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d953098b-a59a-4c4d-88df-4bb5a864ceb4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1225 microversion: 2.1 time: 0.129302 Sep 23 15:18:24.064838 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:24.068783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:24.069611 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 17/29] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:23 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:24.072329 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:24.073458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:24.078189 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:24.080199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:24.233712 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:24.246772 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:24.248254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:24.251244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-df9bb687-0c90-4e49-a0da-3dd361c85e7b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1285 microversion: 2.20 time: 0.206467 Sep 23 15:18:24.263311 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 13/30] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:24 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:18:24.580579 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:24.581257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:24.596020 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:24.606006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:24.606598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:24.608889 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:24.611087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:24.611865 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:24.771741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:24.788325 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-0009bf69-cc5e-4282-a857-79f4934765fc tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1241 microversion: 2.1 time: 0.210974 Sep 23 15:18:24.812433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 18/31] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:24 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1241 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:24.844163 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:24.844855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:24.868750 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:24.870089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:24.872254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:24.873197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:24.874846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:24.877279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:25.083800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:25.084958 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:25.109130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:25.111742 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:25.114679 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:25.120317 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:25.122819 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:25.123705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:25.427076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:25.436768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4d305903-3f29-41ad-a59a-d233c014cc77 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1273 microversion: 2.1 time: 0.598365 Sep 23 15:18:25.440326 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 14/32] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:24 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1273 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:25.457434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:25.460404 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:25.475923 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=4 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:25.485194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:25.485573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:25.489615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:25.490421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:25.492567 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:25.495306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:25.516452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:25.531346 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-eb556de0-cdee-4118-a021-900ce84a7d67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1217 microversion: 2.1 time: 0.453443 Sep 23 15:18:25.537698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 19/33] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:25 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1217 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:25.814640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:25.821283 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:25.821948 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:25.849664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:25.851737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:25.859158 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:25.859582 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:25.860372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:25.864413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-61b9e45d-3b90-4969-9169-783729d8658c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.421771 Sep 23 15:18:25.865981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:25.866532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:25.866970 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:25.871881 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 15/34] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:25 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:26.475429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:26.476106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:26.490597 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:26.491092 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:26.491541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:26.492325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:26.494510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:26.495125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:26.615947 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:26.639856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7860b050-c459-4330-9585-3da92802027d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1289 microversion: 2.1 time: 0.830104 Sep 23 15:18:26.658271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 20/35] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:25 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1289 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:26.676543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:26.677262 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:26.691285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:26.695488 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:26.699484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:26.702974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:26.703980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:26.707294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:26.976336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:26.993077 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b5cf0c2c-fff8-41b2-a614-799c49799e08 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1217 microversion: 2.1 time: 0.329107 Sep 23 15:18:26.995461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 21/36] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:26 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1217 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:27.026019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:27.026606 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:27.077367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:27.082688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:27.085037 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:27.086660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:27.093099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:27.094069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:27.426831 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:27.441177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:27.443384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:27.450239 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1ec68288-ca79-43af-a277-6d9aa6bd6679 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.447824 Sep 23 15:18:27.451381 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 22/37] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:26 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:27.667185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:27.667902 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:27.682541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:27.684282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:27.685857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:27.687508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:27.690565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:27.693379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:27.906849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:27.928009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cc68a04e-14d0-4bc7-818f-072b423fe4fa tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.266561 Sep 23 15:18:27.931203 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 23/38] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:27 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:27.996739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:28.028966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bc825bf0-f7a9-4caf-8dbc-2666b3001892 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 1.546857 Sep 23 15:18:28.028966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 16/39] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:26 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:28.029194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:28.029194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:28.040511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.041051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.041482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:28.044515 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.047030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.047980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:28.166046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:28.175485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ed30ecfd-6864-416b-aad8-4afd057e276f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.154109 Sep 23 15:18:28.176072 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 24/40] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:28 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:28.306552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-80c024f4-81fb-4c50-829a-ca74b0420ece req-67adbf14-f18a-4da1-a7b6-1a3f993e35e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c685e650-6379-4809-8cec-3549d4a26ab1", "tag": "2cdd4723-27d8-4995-a49c-6967ba24fa7e"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:28.327773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-80c024f4-81fb-4c50-829a-ca74b0420ece req-67adbf14-f18a-4da1-a7b6-1a3f993e35e2 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.328534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-80c024f4-81fb-4c50-829a-ca74b0420ece req-67adbf14-f18a-4da1-a7b6-1a3f993e35e2 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.329189 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-80c024f4-81fb-4c50-829a-ca74b0420ece req-67adbf14-f18a-4da1-a7b6-1a3f993e35e2 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:28.357069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-80c024f4-81fb-4c50-829a-ca74b0420ece req-67adbf14-f18a-4da1-a7b6-1a3f993e35e2 service nova] Creating event network-changed:2cdd4723-27d8-4995-a49c-6967ba24fa7e for instance c685e650-6379-4809-8cec-3549d4a26ab1 on hv-cinder-85501 Sep 23 15:18:28.357831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-80c024f4-81fb-4c50-829a-ca74b0420ece req-67adbf14-f18a-4da1-a7b6-1a3f993e35e2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120918) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 15:18:28.358356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-80c024f4-81fb-4c50-829a-ca74b0420ece req-67adbf14-f18a-4da1-a7b6-1a3f993e35e2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120918) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 15:18:28.359725 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.361783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.362841 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:28.363785 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.364376 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.364956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:28.375756 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.compute.rpcapi [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 15:18:28.378025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] Releasing lock "compute-rpcapi-router" {{(pid=120918) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 15:18:28.395762 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0b0f3a21-54b5-4c60-9516-fec335a83c8b None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158882 Sep 23 15:18:28.398958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 17/41] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:28.477502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:28.479438 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:28.491138 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.492063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.492828 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:28.493854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.495246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.496193 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:28.616763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:28.641785 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:28.648095 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:28.649708 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-54147d29-78a0-48fb-a235-385beef13704 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.177351 Sep 23 15:18:28.651236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 25/42] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:28 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:28.955694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:28.956766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:28.963470 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.964223 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.965134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:28.966030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:28.967294 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:28.967933 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:29.045636 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:29.047452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:29.059830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:29.061761 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:29.062277 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:29.062719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:29.066811 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:29.067344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:29.069968 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:29.072328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0b202cc8-2ab6-48ef-895d-8d4c134ce2af tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.121178 Sep 23 15:18:29.077129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 18/43] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:28 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:29.202276 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:29.203343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:29.213925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:29.214730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:29.215355 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:29.216408 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:29.217223 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:29.217720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:29.317770 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:29.331252 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1d6d2405-e853-468b-8b63-11788307de30 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.133182 Sep 23 15:18:29.332509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 19/44] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:29 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:29.363739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:29.372246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-abc86318-be28-4610-9e0d-0766bf499595 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.331409 Sep 23 15:18:29.373142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 26/45] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:29 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:29.558858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-c19e4683-062c-455e-ac76-f2fa7585f483 req-e940fd2e-5512-4010-884c-5abd236a9e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "388c3ec1-6dc6-44b8-b711-58a0cf68f061", "tag": "e1def8de-4010-4053-8bd1-c1cc1548cb27"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:29.576426 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-c19e4683-062c-455e-ac76-f2fa7585f483 req-e940fd2e-5512-4010-884c-5abd236a9e3b service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:29.576945 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-c19e4683-062c-455e-ac76-f2fa7585f483 req-e940fd2e-5512-4010-884c-5abd236a9e3b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:29.577400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-c19e4683-062c-455e-ac76-f2fa7585f483 req-e940fd2e-5512-4010-884c-5abd236a9e3b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:29.588299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-c19e4683-062c-455e-ac76-f2fa7585f483 req-e940fd2e-5512-4010-884c-5abd236a9e3b service nova] Creating event network-changed:e1def8de-4010-4053-8bd1-c1cc1548cb27 for instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 on hv-cinder-85501 Sep 23 15:18:29.593300 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-c19e4683-062c-455e-ac76-f2fa7585f483 req-e940fd2e-5512-4010-884c-5abd236a9e3b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169664 Sep 23 15:18:29.593879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 20/46] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:29.679435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:29.680371 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:29.686800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:29.687275 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:29.687696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:29.688386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:29.688933 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:29.690248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:29.761052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:29.761900 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:29.768118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:29.769581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:29.770684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b44f3e84-96f7-4f71-9f4f-1116c6147bbf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.095293 Sep 23 15:18:29.771223 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 27/47] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:29 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:18:30.097032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:30.097806 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:30.106545 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:30.107319 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:30.107921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:30.108871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:30.109421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:30.109908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:30.196115 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:30.204912 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0c952c73-5895-4e92-839b-a3cfc0ccc03d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.112676 Sep 23 15:18:30.205513 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 21/48] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:30 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:30.357534 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:30.358051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:30.365128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:30.365874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:30.366513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:30.367335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:30.367834 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:30.368449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:30.400076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:30.401004 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:30.411323 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:30.412004 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:30.412743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:30.413677 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:30.414498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:30.415096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:30.434282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:30.445238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f8573b55-1e0c-4b97-9d42-1ebca3559d4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.091611 Sep 23 15:18:30.446105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 28/49] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:30 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:30.600551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:30.616666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-acaf1c86-571f-4827-b873-cda5830e34ff tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.224210 Sep 23 15:18:30.617418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 22/50] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:30 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:30.795509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:30.796121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:30.804043 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:30.804532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:30.805016 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:30.805699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:30.807350 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:30.811701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:30.899954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:30.912287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:30.914298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:30.915580 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a073152f-d94e-40e8-839d-8fe612c5166c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.124084 Sep 23 15:18:30.916573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 29/51] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:30 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:31.227707 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:31.229096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:31.239902 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:31.240424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:31.241057 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:31.241918 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:31.242387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:31.242958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:31.316116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:31.324356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-694d1aeb-2bde-45d5-9e37-175a1c96510e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.100471 Sep 23 15:18:31.324949 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 23/52] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:31 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:31.467285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:31.467953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:31.474179 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:31.474821 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:31.475258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:31.476024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:31.476558 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:31.477068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:31.547068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:31.555225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dfa72109-e48c-4df4-88c5-cbca489147cd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.091780 Sep 23 15:18:31.555874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 30/53] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:31 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:31.641403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:31.642105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:31.647859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:31.653010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:31.654210 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:31.654656 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:31.655616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:31.656412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:31.657017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:31.829033 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:31.836956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3b863d5d-4736-4764-ae79-6f8bd2a2f02d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.199433 Sep 23 15:18:31.837883 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 24/54] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:31 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:31.941076 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:31.941597 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:31.944491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:31.947884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:31.948359 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:31.948814 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:31.949497 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:31.949940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:31.950992 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:32.015796 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:32.024986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:32.026860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:32.028020 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d31cf665-d11f-4c9d-95da-dea8ae2610a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.091134 Sep 23 15:18:32.029062 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 31/55] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:31 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:32.349283 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:32.349889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:32.358262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:32.359099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:32.359518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:32.360243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:32.360720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:32.361488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:32.440305 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:32.448655 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5162fc47-7ef5-4a5f-bb06-c9c0d3d62b57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.103692 Sep 23 15:18:32.449233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 25/56] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:32 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:32.579330 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:32.581485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:32.589494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:32.591153 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:32.591781 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:32.592770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:32.593522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:32.594114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:32.696363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:32.706340 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-be12c440-761c-4647-a03c-a2becfb27096 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.130517 Sep 23 15:18:32.707279 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 32/57] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:32 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:32.860663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:32.862899 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:32.871710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:32.872225 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:32.878534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:32.881283 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:32.881778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:32.882209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:33.054054 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:33.054880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:33.063947 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:33.065064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:33.065770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:33.066691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:33.067299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:33.067871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:33.125609 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:33.138228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-aec207f2-fb43-4c9d-be24-2d3425877504 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.281526 Sep 23 15:18:33.138828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 26/58] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:32 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:33.154099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:33.164909 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:33.168274 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:33.169918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-08a4f08d-6beb-4722-8bf8-b49fee93086a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.121422 Sep 23 15:18:33.188904 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 33/59] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:33 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:33.471741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:33.472228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:33.485960 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=26 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:33.488649 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:33.489460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:33.490124 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:33.491351 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:33.492469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:33.493198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:33.514318 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:33.586703 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:33.606224 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-be8f4822-c6a5-4b54-8cfe-6cd587b82f5d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.138351 Sep 23 15:18:33.620640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 27/60] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:33 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:33.730009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:33.730794 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:33.733969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=24 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:33.740026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:33.740769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:33.741242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:33.741956 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:33.742408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:33.742884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:33.807856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:33.838110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-679bf085-bbaa-4411-80eb-bd6d7d6404d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.090262 Sep 23 15:18:33.838784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 34/61] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:33 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:34.163754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:34.164382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:34.171741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:34.173444 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:34.173998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:34.176671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:34.177181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:34.177621 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:34.201712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:34.202684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:34.213828 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:34.214621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:34.217377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:34.219024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:34.219500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:34.219938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:34.342051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:34.354887 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:34.356332 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:34.363984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-449a9e21-6cb0-4d0b-9715-3e74f309a7dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.160353 Sep 23 15:18:34.364952 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 35/62] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:34 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:34.386120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:34.394870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4baa70a3-0f03-4ee6-a341-a12c83c3182a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.235124 Sep 23 15:18:34.395458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 28/63] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:34 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:34.637026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:34.637639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:34.644620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:34.646114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:34.646562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:34.647384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:34.647845 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:34.648441 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:34.715910 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:34.724513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ea1d44a3-f9c3-48ac-9b5c-a5a5d971f5ae tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.091319 Sep 23 15:18:34.725122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 36/64] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:34 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:34.866623 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:34.867282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:34.873459 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:34.873947 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:34.874395 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:34.875076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:34.875530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:34.875958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:34.950246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:34.958313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e3af9cd6-4fb7-42bf-ae88-5799985d8b64 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.096104 Sep 23 15:18:34.958910 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 29/65] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:34 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:35.390944 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:35.392524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:35.408611 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:35.409372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:35.409848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:35.410554 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:35.411006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:35.411427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:35.418879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:35.419586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:35.434345 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:35.435086 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:35.435704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:35.436572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:35.437291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:35.437863 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:35.493420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:35.514287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:35.526466 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:35.527613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-08623f2c-4fb2-4437-8974-b69a4a907430 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.141083 Sep 23 15:18:35.528168 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 37/66] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:35 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:35.620219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:35.628632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-81257ad6-45ee-4a60-a839-c9c5a94d743e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.214057 Sep 23 15:18:35.629299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 30/67] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:35 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:35.747519 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:35.748378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:35.771439 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:35.771932 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:35.772370 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:35.773113 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:35.773705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:35.773994 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:35.857991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:35.866605 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5c5fa2c6-8d25-48f9-bceb-10a868c79e68 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.123137 Sep 23 15:18:35.867799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 38/68] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:35 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:35.981945 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:35.982727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:35.990416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:35.991407 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:35.991889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:35.992696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:35.993150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:35.993571 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:36.064342 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:36.085443 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-36c24d6f-dc6f-4734-8359-dec4c5cac57f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.107895 Sep 23 15:18:36.086283 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 31/69] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:35 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:36.553985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:36.555657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:36.561783 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:36.563954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:36.564750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:36.565996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:36.566753 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:36.567451 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:36.637408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:36.646248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:36.647950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:36.649157 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-72c80195-f4fe-4d7a-a908-e572f1018d07 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.100554 Sep 23 15:18:36.649914 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 39/70] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:36 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:36.652921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:36.653533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:36.659636 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:36.660106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:36.660797 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:36.661667 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:36.662113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:36.662592 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:36.844060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:36.852960 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d00b8960-19f2-4396-a69c-c11da1cd792d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.204057 Sep 23 15:18:36.853647 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 32/71] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:36 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:36.889663 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:36.890294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:36.897008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:36.897509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:36.897981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:36.898751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:36.899195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:36.899619 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:36.974536 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:36.997951 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f90dde53-02fe-41b8-af62-1f94e0781c8d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.112141 Sep 23 15:18:36.999122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 40/72] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:36 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:37.111726 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:37.114205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:37.126512 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:37.127749 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:37.130765 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:37.131781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:37.132433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:37.133407 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:37.237087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:37.238666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-33c61de2-e7cf-4914-b9fa-eed6ed0201e6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.129580 Sep 23 15:18:37.239262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 33/73] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:37 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:37.678039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:37.679626 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:37.695969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:37.709571 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:37.710725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:37.712426 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:37.713245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:37.714054 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:37.826141 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:37.835240 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:37.836740 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:37.837851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-017708b1-9c4c-4f72-a1d0-84b966638e90 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.167033 Sep 23 15:18:37.838590 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 41/74] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:37 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:18:37.877305 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:37.878055 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:37.884623 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:37.885953 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:37.886548 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:37.887473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:37.888217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:37.888710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:38.022497 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:38.023112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:38.032815 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:38.033245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:38.035015 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:38.035735 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:38.036197 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:38.036641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:38.042280 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:38.050259 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6db3fc45-48c7-4c55-9e77-ed3ee21d3ef5 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.177724 Sep 23 15:18:38.050843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 34/75] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:37 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:38.107675 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:38.116294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f749f3d2-7186-4b8b-828b-0e9a616faedd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.098135 Sep 23 15:18:38.116991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 42/76] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:38 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:38.265588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:38.266471 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:38.274457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:38.275068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:38.275607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:38.276375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:38.277290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:38.277840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:38.343977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:38.352132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-df2cb757-9257-4b74-8991-eefa9746394f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.090920 Sep 23 15:18:38.352736 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 35/77] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:38 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:38.863354 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:38.864126 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:38.871039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:38.871524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:38.871956 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:38.872644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:38.873129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:38.873550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:38.933613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:38.941982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:38.943425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:38.944527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-018736f4-e477-475a-a7f4-c680da179c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.085578 Sep 23 15:18:38.945123 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 43/78] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:38 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:39.073973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:39.074595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:39.076671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=8 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:39.083136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:39.083834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:39.084304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:39.085028 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:39.085477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:39.085896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:39.138437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:39.139060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:39.145269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:39.145761 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:39.146197 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:39.146898 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:39.147352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:39.147740 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:39.166524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:39.218984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:39.229432 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-71fa586d-5876-438a-84ce-5f198f2bfda1 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.094371 Sep 23 15:18:39.230600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 44/79] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:39 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:39.236756 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:39.247485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6e8b022e-ac94-41c3-a317-57e6fbadc074 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.177320 Sep 23 15:18:39.248256 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 36/80] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:39 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:39.375296 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:39.376107 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:39.382409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:39.382888 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:39.383508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:39.383999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:39.384398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:39.384841 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:39.446924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:39.455175 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d308ade5-895f-499e-9803-38fd5f460244 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.083610 Sep 23 15:18:39.455847 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 45/81] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:39 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:39.974958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:39.975864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:39.985627 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:39.986476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:39.987463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:39.988298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:39.988798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:39.989245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:40.051473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:40.060140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:40.061641 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:40.062767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4a151430-bb3d-40d2-b187-517afa000db2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.094785 Sep 23 15:18:40.063342 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 37/82] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:39 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:40.255860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:40.256408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:40.263801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:40.264316 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:40.264822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:40.265769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:40.266225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:40.266646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:40.275725 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:40.276339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:40.282627 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:40.283122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:40.283607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:40.284462 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:40.284963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:40.285435 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:40.330591 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:40.338700 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a3913e7e-74d7-451f-9dc6-61b5be749649 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.088804 Sep 23 15:18:40.339269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 46/83] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:40 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:40.421563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:40.433721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bc8b6211-43c9-4e04-b799-502a000d4bcb tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.161882 Sep 23 15:18:40.434286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 38/84] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:40 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:40.478605 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:40.479219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:40.485767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:40.486336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:40.486798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:40.487612 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:40.488452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:40.488925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:40.559446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:40.567769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-37a9b189-c613-49ff-893f-d9c8be6f03df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1273 microversion: 2.1 time: 0.093305 Sep 23 15:18:40.568334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 47/85] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:40 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:41.089242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:41.089975 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:41.096921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:41.097464 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:41.098084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:41.098816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:41.099251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:41.099987 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:41.218402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:41.229693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:41.231748 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:41.233646 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0071b1ba-0829-44ea-9746-97ab1d0f976e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1277 microversion: 2.20 time: 0.148186 Sep 23 15:18:41.234363 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 39/86] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:41 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:41.366064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:41.366753 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:41.380169 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:41.383355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:41.383991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:41.385530 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:41.386314 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:41.388188 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:41.457101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:41.457952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:41.471041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:41.473354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:41.474467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:41.476103 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:41.479164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:41.479882 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:41.659095 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:41.673666 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2b232b10-67c5-4079-bbfa-e996d9281169 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1295 microversion: 2.1 time: 0.314324 Sep 23 15:18:41.676755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 48/87] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:41 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1295 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:41.682682 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:41.683288 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:41.689710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:41.690565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:41.691449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:41.692159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:41.692667 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:41.693153 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:41.812246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:41.846449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a3a7dbf6-8404-4ebc-b804-500d7fec3ebb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1291 microversion: 2.1 time: 0.168349 Sep 23 15:18:41.853206 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 49/88] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:41 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1291 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:41.884391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:41.895733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c1efaad2-503e-4fe4-b38a-de7f51450a9e tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.442626 Sep 23 15:18:41.910507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 40/89] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:41 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:42.267898 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:42.268977 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:42.293067 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:42.293560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:42.293990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:42.294838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:42.295398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:42.295819 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:42.387572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:42.397051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:42.398461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:42.399567 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7875ae3d-5d56-4394-bfa7-052f6ef16bfe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1333 microversion: 2.20 time: 0.140149 Sep 23 15:18:42.400125 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 50/90] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:42 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1333 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:42.705883 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:42.706643 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:42.713776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:42.714316 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:42.714799 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:42.715568 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:42.716076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:42.716552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:42.847929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:42.855740 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a678203b-6044-4dcf-b186-ee05f9de13db tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.156637 Sep 23 15:18:42.856324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 41/91] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:42 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:42.883699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:42.884327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:42.890746 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:42.891236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:42.891666 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:42.892356 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:42.892859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:42.893545 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:42.921098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:42.921822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:42.928800 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:42.929371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:42.930037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:42.930809 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:42.931336 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:42.931843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:42.959177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:42.967249 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-24d3f7e9-dd42-4d02-acff-4b4393b9b815 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1291 microversion: 2.1 time: 0.087532 Sep 23 15:18:42.967930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 51/92] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:42 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1291 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:43.062515 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:43.070881 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1e05d802-d0df-4919-b26c-aa03b4fc755d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.153673 Sep 23 15:18:43.071747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 42/93] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:42 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:43.424671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:43.425726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:43.432196 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:43.432716 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:43.433149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:43.433837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:43.434306 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:43.434704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:43.503833 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:43.512386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:43.513871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:43.514961 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-60c718f2-eea9-4724-923f-0dd321621429 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1333 microversion: 2.20 time: 0.094257 Sep 23 15:18:43.515520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 52/94] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:43 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:43.886180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:43.887184 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:43.897991 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:43.898752 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:43.899479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:43.900626 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:43.901386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:43.902080 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:43.990776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:43.991386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:43.998090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:43.998467 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:43.999040 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:44.000122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:44.000675 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:44.001202 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:44.052144 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:44.060361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9c088669-cf00-446d-8184-024eb859f8d7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.180600 Sep 23 15:18:44.061366 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 43/95] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:43 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:44.063534 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:44.072361 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-97cacc96-01d7-4036-a8f3-ecc3790bb9fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1291 microversion: 2.1 time: 0.085902 Sep 23 15:18:44.072987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 53/96] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:43 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1291 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:44.094187 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:44.094766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:44.101091 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:44.101569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:44.102001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:44.102683 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:44.103135 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:44.103554 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:44.107523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:44.233713 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:44.242601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-823de4b7-c8e6-438c-b3c8-5f1746353daa tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.152221 Sep 23 15:18:44.243171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 44/97] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:44 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:44.539592 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:44.540176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:44.546768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:44.547251 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:44.547676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:44.548386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:44.548863 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:44.549281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:44.616759 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:44.625188 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:44.626645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:44.627780 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-979f2daf-0c90-4dd3-900e-2d38dc03f7bf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1333 microversion: 2.20 time: 0.092181 Sep 23 15:18:44.628405 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 54/98] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:44 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:45.087418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:45.088536 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:45.098731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:45.099551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:45.099791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:45.100268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:45.100826 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:45.101484 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:45.102298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:45.103007 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:45.111055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:45.111850 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:45.113088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:45.114063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:45.114520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:45.114939 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:45.182866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:45.192386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f916891f-e610-4ac6-bacc-2e577efe6e2d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1291 microversion: 2.1 time: 0.099200 Sep 23 15:18:45.193128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 55/99] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:45 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1291 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:45.242107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:45.249910 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-475c0f8f-1a9f-42bb-860d-2fa6f6ba7448 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.169601 Sep 23 15:18:45.250484 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 45/100] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:45 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:45.265465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:45.266066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:45.273917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:45.274648 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:45.275322 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:45.276395 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:45.277097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:45.277700 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:45.417925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:45.426466 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5c1d58f0-ee68-4251-8ab2-bb31fe28f6be tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.164861 Sep 23 15:18:45.427233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 56/101] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:45 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:45.657632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:45.658433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:45.666719 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:45.667238 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:45.674445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:45.675924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:45.676445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:45.676906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:45.808789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:45.842211 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:45.846005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:45.850304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-705f26af-8e51-4bf8-8017-939e69e35838 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1333 microversion: 2.20 time: 0.197481 Sep 23 15:18:45.859649 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 46/102] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:45 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1333 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:46.218675 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:46.219684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:46.227843 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:46.228877 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:46.229993 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:46.231160 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:46.231993 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:46.232766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:46.276215 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:46.278354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:46.286090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:46.286894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:46.287614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:46.288607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:46.289316 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:46.290634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:46.412159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:46.424998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3bf28409-cc09-4a62-8a36-14a0b0335135 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1279 microversion: 2.1 time: 0.213193 Sep 23 15:18:46.426455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 57/103] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:46 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1279 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:46.451768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:46.452734 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:46.460431 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:46.461298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:46.474361 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:46.475616 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:46.478308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:46.479012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:46.926553 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:46.935890 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-945eea98-b062-41b8-be85-baeed8d64593 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.665411 Sep 23 15:18:46.936623 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 47/104] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:46 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:46.941754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:46.942611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:46.949051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:46.949800 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:46.950607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:46.951563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:46.952228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:46.952907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:46.976671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:46.987660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bb6698a8-bd19-4701-b2ef-7613c3a65c5a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.540042 Sep 23 15:18:46.989259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 58/105] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:46 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:47.056489 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-ca03f578-c04b-4725-aa61-8e98e706ee6b req-8f62d4eb-1a79-4b59-915c-9f7d3ab656f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b92954-0cb5-4c21-ab67-8f80c5be9eb9", "tag": "5073b565-7790-42c1-a11b-5c4328b5da4a"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:47.075653 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-ca03f578-c04b-4725-aa61-8e98e706ee6b req-8f62d4eb-1a79-4b59-915c-9f7d3ab656f8 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:47.076568 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-ca03f578-c04b-4725-aa61-8e98e706ee6b req-8f62d4eb-1a79-4b59-915c-9f7d3ab656f8 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:47.077213 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-ca03f578-c04b-4725-aa61-8e98e706ee6b req-8f62d4eb-1a79-4b59-915c-9f7d3ab656f8 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:47.103658 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-ca03f578-c04b-4725-aa61-8e98e706ee6b req-8f62d4eb-1a79-4b59-915c-9f7d3ab656f8 service nova] Creating event network-changed:5073b565-7790-42c1-a11b-5c4328b5da4a for instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 on hv-cinder-85501 Sep 23 15:18:47.104655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-ca03f578-c04b-4725-aa61-8e98e706ee6b req-8f62d4eb-1a79-4b59-915c-9f7d3ab656f8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 15:18:47.105423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-ca03f578-c04b-4725-aa61-8e98e706ee6b req-8f62d4eb-1a79-4b59-915c-9f7d3ab656f8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 15:18:47.106785 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:47.107431 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:47.108516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:47.110374 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:47.111976 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:47.113148 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:47.134475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.compute.rpcapi [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 15:18:47.135850 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] Releasing lock "compute-rpcapi-router" {{(pid=120919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 15:18:47.143351 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:47.156507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:47.158354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:47.160990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bdf3b326-7509-47d3-a603-e516d50a0f95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1339 microversion: 2.20 time: 0.222954 Sep 23 15:18:47.162025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 48/106] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:46 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1339 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:47.193033 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8bd8d3d0-b029-40e3-ad96-08197354a023 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141952 Sep 23 15:18:47.195378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 59/107] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:47.449442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:47.450022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:47.457529 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:47.458037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:47.458474 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:47.459183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:47.459637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:47.460056 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:47.619875 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:47.628295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c18a4d2e-ecc0-4edb-b1c3-56dd903d3799 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.182603 Sep 23 15:18:47.629121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 49/108] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:47 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:47.970041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:47.970741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:47.979172 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:47.979894 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:47.980520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:47.981464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:47.981984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:47.982533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:48.011818 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:48.012677 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:48.021844 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:48.029245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:48.040908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:48.041843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:48.042397 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:48.043032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:48.244231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:48.253011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-64c60e61-1ab7-4a98-9105-4a05f9a630a4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.294279 Sep 23 15:18:48.253458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:48.264615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 60/109] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:47 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:48.264615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:48.264615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:48.267838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:48.268673 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:48.269494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:48.270974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:48.271838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:48.272400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:48.278629 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fc6187ad-bbe7-473b-8c0c-6f31df0f25f7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.270854 Sep 23 15:18:48.284642 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 50/110] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:48 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:48.300780 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:48.420631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:48.432166 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:48.433741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:48.435236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e6d6a45c-fc3b-40d9-aaaf-39c0a5d8e672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.180192 Sep 23 15:18:48.436456 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 61/111] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:48 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:48.655391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:48.656383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:48.667000 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:48.667785 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:48.668495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:48.669723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:48.670456 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:48.671108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:48.812631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:48.822084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c45ff4d5-834d-4eb4-ac87-2aef3efa930e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.173309 Sep 23 15:18:48.822901 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 51/112] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:48 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:49.280264 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:49.281108 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:49.287606 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:49.288089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:49.288525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:49.289289 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:49.289743 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:49.290164 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:49.301951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:49.302697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:49.308848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:49.309325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:49.310044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:49.310731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:49.311384 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:49.311986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:49.470445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:49.474522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:49.484839 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-75290235-4c57-41fa-871a-e651d21d18f2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.207771 Sep 23 15:18:49.484839 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 62/113] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:49 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:49.489874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:49.490484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:49.496665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:49.497521 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:49.497953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:49.498654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:49.499095 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:49.499687 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:49.503340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-25e7061c-85f0-41e4-a399-ff8f00dc01d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.205428 Sep 23 15:18:49.520126 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 52/114] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:49 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:49.638688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:49.649174 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:49.651067 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:49.652255 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-892b0b32-d3a5-4aeb-8a5e-99c308ff681b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.167109 Sep 23 15:18:49.652771 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 63/115] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:49 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:49.845907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:49.846536 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:49.852875 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:49.853362 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:49.853861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:49.854580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:49.855035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:49.855454 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:49.989414 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:49.997279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9f9699df-ecf2-4ad0-8af3-59b17bf53143 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.155301 Sep 23 15:18:49.997864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 53/116] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:49 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:50.507609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:50.508353 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:50.517596 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:50.517596 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:50.517596 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:50.517596 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:50.518060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:50.518060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:50.527344 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:50.528250 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:50.534812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:50.535599 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:50.535599 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:50.536931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:50.537595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:50.538053 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:50.662855 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:50.668203 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:50.670895 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2af87f23-660e-4dd9-817c-fd6ea97f7338 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.167282 Sep 23 15:18:50.672796 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 64/117] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:50 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:50.677760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-921c44cf-686a-4eec-8ef9-5f2589729be1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.154259 Sep 23 15:18:50.678187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:50.679154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 54/118] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:50 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:50.679271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:50.690135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:50.690691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:50.691057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:50.692164 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:50.692298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:50.692707 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:50.821499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:50.832986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:50.835075 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:50.836786 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7e3d3f8b-060a-4e09-be73-d5cf6e72319d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.162340 Sep 23 15:18:50.837577 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 65/119] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:50 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:51.019860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:51.020536 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:51.026869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:51.027346 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:51.027782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:51.028471 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:51.028960 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:51.029383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:51.165149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:51.176369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ae4a7583-d42b-4e77-a333-faddcad9481e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.160037 Sep 23 15:18:51.176566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 55/120] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:51 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:51.697741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:51.698748 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:51.704755 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:51.705767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:51.708684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:51.709197 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:51.709637 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:51.710326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:51.710780 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:51.711194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:51.712969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:51.713461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:51.713891 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:51.714609 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:51.715067 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:51.715490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:51.850934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:51.852078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:51.860408 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-361aeeea-f7d2-427d-8695-8b12dfd476a4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.162203 Sep 23 15:18:51.861014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 56/121] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:51 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:51.861714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ae67be5d-81b7-4a1e-823c-5cb77f1ac831 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.170518 Sep 23 15:18:51.865978 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:51.866582 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:51.872567 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:51.873068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:51.873499 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:51.874188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:51.874639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:51.875058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:51.877012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 66/122] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:51 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:52.007545 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:52.016527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:52.018012 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:52.019145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-16e23d7f-ba0c-4b53-8d82-03b336ebbb8e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.157216 Sep 23 15:18:52.019708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 57/123] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:51 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:52.200197 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:52.200966 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:52.207464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:52.207998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:52.208433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:52.209156 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:52.209604 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:52.210055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:52.347155 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:52.355115 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c9f9831c-71b7-40ac-8b76-3d1310b4cdda tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.159397 Sep 23 15:18:52.355713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 67/124] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:52 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:52.883727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:52.884303 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:52.886528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:52.887124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:52.890990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:52.891457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:52.891889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:52.892614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:52.893070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:52.893498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:52.893627 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:52.894101 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:52.894525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:52.895482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:52.896142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:52.896556 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:53.026242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:53.029779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:53.034189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-40c3269f-39f7-40dc-a377-0a513a38a88d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.151627 Sep 23 15:18:53.034767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 68/125] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:52 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:18:53.038151 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6df138f4-0a98-4539-b71f-2dd99f7c621d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.158605 Sep 23 15:18:53.038928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 58/126] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:52 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:53.044941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:53.045674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:53.052137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:53.052613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:53.053066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:53.053757 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:53.054201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:53.054613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:53.185149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:53.198410 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:53.200693 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:53.202285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f69e8fd4-9b78-46cb-b368-125fb037268c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.161053 Sep 23 15:18:53.203592 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 69/127] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:53 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:53.378934 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:53.379535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:53.385849 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:53.386262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:53.386721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:53.387424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:53.387874 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:53.388301 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:53.522320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:53.530306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ebb7d261-5f12-46a1-b7d3-db48dec793b2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.155225 Sep 23 15:18:53.530854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 59/128] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:53 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:54.061563 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:54.062589 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:54.065265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:54.066368 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:54.073968 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:54.074790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:54.075537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:54.076664 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:54.077455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:54.077677 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:54.078153 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:54.078378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:54.079038 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:54.080161 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:54.080953 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:54.081635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:54.212271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:54.214097 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:54.217583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:54.220908 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f255b430-02a0-4248-9751-91cffc687787 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.165996 Sep 23 15:18:54.221490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 70/129] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:54 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:54.222548 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8a9e12ce-7d01-41a0-bcc5-4780a8cfa577 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.164207 Sep 23 15:18:54.223192 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 60/130] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:54 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:54.232051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:54.232906 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:54.240069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:54.240546 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:54.241050 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:54.241744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:54.242222 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:54.242639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:54.370800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:54.378962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:54.380525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:54.381656 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cc13e7de-0731-45e0-bc4d-e5e960d64b42 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.154381 Sep 23 15:18:54.382220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 71/131] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:54 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:18:54.553198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:54.553808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:54.560540 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:54.561129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:54.561574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:54.562234 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:54.562679 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:54.563090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:54.698836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:54.707190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e9ba787c-5c7b-4227-bc2e-9276fc425732 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.157934 Sep 23 15:18:54.707738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 61/132] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:54 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:55.244654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:55.245243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:55.245601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:55.245676 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:55.251727 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:55.252230 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:55.252674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:55.252845 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:55.253184 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:55.253590 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:55.253737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:55.254094 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:55.254281 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:55.254507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:55.254729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:55.255227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:55.391150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:55.392139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:55.401269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a0caab60-e3b5-4697-9608-097be82db51d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.160027 Sep 23 15:18:55.402176 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 62/133] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:55 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:55.411828 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8f5eb48f-37f2-40af-8c62-4b1024dee211 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.162141 Sep 23 15:18:55.417066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 72/134] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:55 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:55.425725 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:55.426341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:55.435027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:55.435872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:55.436988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:55.437666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:55.438157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:55.438622 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:55.634845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:55.644708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:55.646390 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:55.647982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3b5fbf4e-31bc-4287-9950-d2dd2d3ead4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.232502 Sep 23 15:18:55.649102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 63/135] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:55 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:55.736923 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:55.737532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:55.744273 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:55.745926 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:55.746567 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:55.747275 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:55.747714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:55.748132 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:56.317621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:56.326287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ff8bd8f5-5c88-41de-a223-984165ccc232 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.594599 Sep 23 15:18:56.341154 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 73/136] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:55 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:56.427134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:56.427815 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:56.432215 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:56.432892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:56.435128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:56.435782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:56.436263 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:56.437101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:56.437646 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:56.438178 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:56.439069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:56.439545 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:56.440164 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:56.440879 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:56.441475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:56.442050 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:56.592558 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:56.600897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-014ebf5a-4d29-4708-b34b-eb3936a8029f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.178002 Sep 23 15:18:56.601757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 64/137] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:56 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:56.679839 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:56.680292 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:56.686714 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:56.687204 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:56.687763 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:56.688458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:56.689058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:56.689397 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:56.797753 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:56.807244 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cdcdc2b3-5986-47be-81e0-171790c32045 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.381215 Sep 23 15:18:56.808872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 74/138] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:56 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:56.848070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:56.857441 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:56.858886 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:56.860093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-82db218e-c757-4584-8e75-1b6f1c34bc6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.184475 Sep 23 15:18:56.860668 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 65/139] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:56 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:18:57.172312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-829ec0aa-c2b9-4c5e-95b6-fb78bc9b1e91 req-d842dbbc-8b69-4f5e-ae66-25eaa8a94b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d9677f-fe5a-4549-91b7-4657540ae97f", "tag": "70760e9f-6d22-46eb-aa3e-f9e855dbf739"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:57.184124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:57.186440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-829ec0aa-c2b9-4c5e-95b6-fb78bc9b1e91 req-d842dbbc-8b69-4f5e-ae66-25eaa8a94b5d service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.186997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-829ec0aa-c2b9-4c5e-95b6-fb78bc9b1e91 req-d842dbbc-8b69-4f5e-ae66-25eaa8a94b5d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.187498 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-829ec0aa-c2b9-4c5e-95b6-fb78bc9b1e91 req-d842dbbc-8b69-4f5e-ae66-25eaa8a94b5d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.220552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-829ec0aa-c2b9-4c5e-95b6-fb78bc9b1e91 req-d842dbbc-8b69-4f5e-ae66-25eaa8a94b5d service nova] Creating event network-changed:70760e9f-6d22-46eb-aa3e-f9e855dbf739 for instance a7d9677f-fe5a-4549-91b7-4657540ae97f on hv-cinder-85501 Sep 23 15:18:57.229105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-829ec0aa-c2b9-4c5e-95b6-fb78bc9b1e91 req-d842dbbc-8b69-4f5e-ae66-25eaa8a94b5d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060451 Sep 23 15:18:57.230897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 75/140] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:57.350932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:57.351288 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:57.371070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.371640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.372078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.372805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.373253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.373664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.469587 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-2ba2709f-36cc-49cd-889e-3b7d88165132 req-d331b4f7-d471-49f7-b34b-569c34e91fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "388c3ec1-6dc6-44b8-b711-58a0cf68f061", "name": "network-vif-plugged", "status": "completed", "tag": "e1def8de-4010-4053-8bd1-c1cc1548cb27"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:57.480215 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-2ba2709f-36cc-49cd-889e-3b7d88165132 req-d331b4f7-d471-49f7-b34b-569c34e91fd3 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.480719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-2ba2709f-36cc-49cd-889e-3b7d88165132 req-d331b4f7-d471-49f7-b34b-569c34e91fd3 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.481145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-2ba2709f-36cc-49cd-889e-3b7d88165132 req-d331b4f7-d471-49f7-b34b-569c34e91fd3 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.499302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-2ba2709f-36cc-49cd-889e-3b7d88165132 req-d331b4f7-d471-49f7-b34b-569c34e91fd3 service nova] Creating event network-vif-plugged:e1def8de-4010-4053-8bd1-c1cc1548cb27 for instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 on hv-cinder-85501 Sep 23 15:18:57.504291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-2ba2709f-36cc-49cd-889e-3b7d88165132 req-d331b4f7-d471-49f7-b34b-569c34e91fd3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135869 Sep 23 15:18:57.505494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 76/141] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:57.562420 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:57.570705 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c29ae5e7-8e61-4155-9fcd-14cc22e29404 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.224538 Sep 23 15:18:57.571781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 66/142] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:57 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:57.627281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:57.628126 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:57.635588 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.636237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.636773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.637566 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.638090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.638827 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.802838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:57.814394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-398201ee-9f63-42aa-a790-b46e403b1585 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.192370 Sep 23 15:18:57.815015 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 77/143] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:57 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:57.830199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:57.830845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:57.837133 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.837608 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.838040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.838747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.839187 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.839603 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.886285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:57.886870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:57.893372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.893848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.894272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.894963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:57.895409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:57.895829 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:57.988331 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:57.997674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-495f290a-0949-43d5-844c-af05e9312248 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.171340 Sep 23 15:18:57.998235 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 67/144] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:57 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:58.035461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:58.043774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:58.045237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:58.046332 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e768ff01-7649-4af6-bd56-8e20005a32fe tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.164367 Sep 23 15:18:58.046890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 78/145] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:57 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:58.594351 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:58.594958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:58.602981 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:58.603285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:58.604014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:58.604751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:58.605203 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:58.605623 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:58.768989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:58.779402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-02b3ee6a-3a3c-4351-bf90-828c9040c9d5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.188954 Sep 23 15:18:58.780118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 68/146] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:58 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:58.839901 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:58.840564 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:58.846554 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:58.847079 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:58.847740 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:58.848539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:58.849041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:58.849450 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:58.871076 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:58.991379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:58.999807 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1c14b763-39f1-4081-ac7f-15f461eb7203 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.164469 Sep 23 15:18:59.000805 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 79/147] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:58 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:59.021224 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:59.021966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:59.028358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:59.029008 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:59.029615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:59.030328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:59.030781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:59.031358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:59.072209 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:59.072909 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:59.079785 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:59.080266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:59.080874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:59.081601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:59.082050 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:59.082468 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:59.178469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:59.187062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-72b498eb-445e-428c-a53c-64d4b6b1c3ab tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.169888 Sep 23 15:18:59.187929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 69/148] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:59 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:18:59.222033 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:59.230700 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:59.232167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:59.233318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-31f5c1e2-ed9c-4513-8d4b-a821b4333189 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.165565 Sep 23 15:18:59.233859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 80/149] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:18:59 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:18:59.281777 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-e988801a-fc7f-4441-97be-ea6be85a384f req-7903b91f-57dc-4340-9997-414126fdb7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95199f41-0774-4f39-912e-97a924ef09eb", "tag": "93652ce2-3bd3-4207-96bf-3c25e56c5c28"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:18:59.292306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e988801a-fc7f-4441-97be-ea6be85a384f req-7903b91f-57dc-4340-9997-414126fdb7a2 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:59.292816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e988801a-fc7f-4441-97be-ea6be85a384f req-7903b91f-57dc-4340-9997-414126fdb7a2 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:59.293244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e988801a-fc7f-4441-97be-ea6be85a384f req-7903b91f-57dc-4340-9997-414126fdb7a2 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:59.304874 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-e988801a-fc7f-4441-97be-ea6be85a384f req-7903b91f-57dc-4340-9997-414126fdb7a2 service nova] Creating event network-changed:93652ce2-3bd3-4207-96bf-3c25e56c5c28 for instance 95199f41-0774-4f39-912e-97a924ef09eb on hv-cinder-85501 Sep 23 15:18:59.310796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-e988801a-fc7f-4441-97be-ea6be85a384f req-7903b91f-57dc-4340-9997-414126fdb7a2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033769 Sep 23 15:18:59.311434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 70/150] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:18:59.804595 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:18:59.805326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:18:59.811449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:18:59.813034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:59.813892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:59.814803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:59.815727 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:18:59.816152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:18:59.816764 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:18:59.977060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:18:59.986047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2686fb5c-4fe3-4f51-8159-758979a41487 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.186406 Sep 23 15:18:59.986613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 81/151] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:18:59 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:00.027106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:00.028215 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:00.035251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:00.035961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:00.036679 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:00.037739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:00.038329 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:00.038889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:00.196834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:00.206302 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-383983a2-227d-4b39-918f-17eec8f93b10 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.185830 Sep 23 15:19:00.207125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 71/152] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:00 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:00.210939 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:00.211886 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:00.218484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:00.218967 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:00.219396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:00.220087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:00.220922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:00.224936 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:00.259170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:00.260010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:00.266156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:00.267023 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:00.268560 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:00.269433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:00.270037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:00.270595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:00.447721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:00.462556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:00.464282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:00.466476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b6587354-598d-4283-80cf-4c173734f30b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.211209 Sep 23 15:19:00.467027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 72/153] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:00 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:00.478531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:00.493023 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d5347780-df4d-48d8-8d89-77039e9b1848 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.285983 Sep 23 15:19:00.494099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 82/154] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:00 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:01.009099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:01.009703 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:01.016864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:01.017265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:01.017692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:01.027318 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:01.028761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:01.030113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:01.240405 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:01.241194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:01.261637 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:01.262217 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:01.262605 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:01.263577 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:01.264387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:01.265185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:01.342355 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:01.354798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c5361ab0-47ec-494a-86ea-9aaef3da4782 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.349319 Sep 23 15:19:01.356806 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 73/155] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:01 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:01.492633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:01.493572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:01.501556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:01.503507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:01.504160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:01.504625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:01.505318 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:01.505915 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:01.506471 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:01.698333 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:01.709591 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8b5768a0-1226-4ddf-bc8f-1b464c65d2e3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.482888 Sep 23 15:19:01.720621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 83/156] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:01 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:01.720621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:01.720621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:01.741258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:01.741258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:01.741258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:01.741258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:01.741817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:01.741817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:01.772765 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:01.783259 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:01.784925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:01.786290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-045aed50-589b-4ae3-a21d-8acc8e2036b7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.298024 Sep 23 15:19:01.787254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 74/157] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:01 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:02.007278 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:02.015941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6abab69b-7fd7-4c0d-8026-5014addd4b2d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.304378 Sep 23 15:19:02.019884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 84/158] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:01 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:02.380555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:02.381183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:02.387887 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:02.388773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:02.389208 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:02.389906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:02.390443 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:02.390753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:02.562991 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:02.572710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a47f042b-f6d8-4c7b-827f-3e96a96e0729 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.196057 Sep 23 15:19:02.573293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 75/159] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:02 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:02.734057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:02.734657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:02.741156 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:02.741652 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:02.742073 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:02.742824 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:02.743497 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:02.743926 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:02.822565 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:02.823380 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:02.832304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:02.832717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:02.833255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:02.834122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:02.834877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:02.835579 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:02.893140 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:02.902681 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6f8aecf7-abd1-4996-8fc8-2c6ac5fa12c0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.172375 Sep 23 15:19:02.908742 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 85/160] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:02 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:03.014814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:03.024375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:03.025898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:03.027015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c2854ac3-1f6a-426b-8bc9-f28f5def3ffa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.211863 Sep 23 15:19:03.027572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 76/161] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:02 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:03.052924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:03.052924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:03.052924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:03.053216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:03.053362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:03.054360 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:03.055060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:03.055532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:03.218013 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:03.232065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dd2afd38-22d7-4441-a45e-dd5e5fdaddce tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.189293 Sep 23 15:19:03.234107 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 86/162] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:03 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:03.599730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:03.600648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:03.613932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:03.616358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:03.616904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:03.618277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:03.618922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:03.620104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:03.801249 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-f254e699-0a03-4f5e-9344-ab62b4e8cb0b req-fd7e0da9-69a3-43bd-a53d-6f034fffc830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c685e650-6379-4809-8cec-3549d4a26ab1", "name": "network-vif-plugged", "status": "completed", "tag": "2cdd4723-27d8-4995-a49c-6967ba24fa7e"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:03.819334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-f254e699-0a03-4f5e-9344-ab62b4e8cb0b req-fd7e0da9-69a3-43bd-a53d-6f034fffc830 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:03.820178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-f254e699-0a03-4f5e-9344-ab62b4e8cb0b req-fd7e0da9-69a3-43bd-a53d-6f034fffc830 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:03.821293 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-f254e699-0a03-4f5e-9344-ab62b4e8cb0b req-fd7e0da9-69a3-43bd-a53d-6f034fffc830 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:03.836485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-f254e699-0a03-4f5e-9344-ab62b4e8cb0b req-fd7e0da9-69a3-43bd-a53d-6f034fffc830 service nova] Creating event network-vif-plugged:2cdd4723-27d8-4995-a49c-6967ba24fa7e for instance c685e650-6379-4809-8cec-3549d4a26ab1 on hv-cinder-85501 Sep 23 15:19:03.847096 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-f254e699-0a03-4f5e-9344-ab62b4e8cb0b req-fd7e0da9-69a3-43bd-a53d-6f034fffc830 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049981 Sep 23 15:19:03.848010 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 87/163] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:19:03.927004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:03.927880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:03.943677 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:03.944223 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:03.944893 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:03.946789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:03.947527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:03.948167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:04.034496 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:04.043674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-87b72dbb-d6fb-4ffb-a1d1-cdd982f5070e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.451870 Sep 23 15:19:04.045938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 77/164] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:03 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:04.051648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:04.052310 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:04.059113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:04.059604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:04.060061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:04.060805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:04.061255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:04.061712 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:04.067311 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:04.166250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:04.176671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c1128ef5-9067-4667-ab06-bd601f465d29 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.253935 Sep 23 15:19:04.181272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 88/165] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:03 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:04.256692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:04.257291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:04.266753 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:04.268009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:04.270513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:04.271691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:04.277019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:04.279776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:04.280371 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:04.297937 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:04.300463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:04.304312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-47816ad3-744d-4b1a-9404-a1de616f6131 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.256752 Sep 23 15:19:04.306579 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 78/166] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:04 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:04.447014 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:04.484775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8e9f5b60-d28a-4cb9-966f-2a006a85584f tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.231688 Sep 23 15:19:04.485365 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 89/167] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:04 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:05.069241 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:05.070126 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:05.076861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.077682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.078107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.079062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.079758 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.080343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.207287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:05.208246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:05.216756 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.217607 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.218389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.219329 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.219829 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:05.220048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.220565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.232195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bae0f6e8-9faa-4828-bdc9-6c6c055e8db1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.167289 Sep 23 15:19:05.233279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 79/168] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:05 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:05.337647 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:05.338330 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:05.346527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.347100 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.347786 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.348624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.349175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.349658 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.412266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:05.422088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8b2263a9-58a3-48c9-951a-cf2f95ee77e7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.221514 Sep 23 15:19:05.423400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 90/169] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:05 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:05.516403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:05.520562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:05.521215 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:05.527009 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:05.528874 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:05.530234 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a8e065b7-c0db-4888-80d2-bad6c3f5fb58 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.200298 Sep 23 15:19:05.531292 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 80/170] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:05 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:05.551004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.551509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.551946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.552688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.553347 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.553770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.715006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:05.729034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-998ae17b-8078-42a6-88bd-c6841d5cb03c tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.224651 Sep 23 15:19:05.730941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 91/171] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:05 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:05.887227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-b3a58258-e020-422a-a72e-eb4907c5f768 req-d0603bed-fd50-4559-9aae-42757035920c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b92954-0cb5-4c21-ab67-8f80c5be9eb9", "name": "network-vif-plugged", "status": "completed", "tag": "5073b565-7790-42c1-a11b-5c4328b5da4a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:05.922075 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-b3a58258-e020-422a-a72e-eb4907c5f768 req-d0603bed-fd50-4559-9aae-42757035920c service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:05.931720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-b3a58258-e020-422a-a72e-eb4907c5f768 req-d0603bed-fd50-4559-9aae-42757035920c service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:05.932364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-b3a58258-e020-422a-a72e-eb4907c5f768 req-d0603bed-fd50-4559-9aae-42757035920c service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:05.969931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-b3a58258-e020-422a-a72e-eb4907c5f768 req-d0603bed-fd50-4559-9aae-42757035920c service nova] Creating event network-vif-plugged:5073b565-7790-42c1-a11b-5c4328b5da4a for instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 on hv-cinder-85501 Sep 23 15:19:05.977349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-b3a58258-e020-422a-a72e-eb4907c5f768 req-d0603bed-fd50-4559-9aae-42757035920c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100593 Sep 23 15:19:05.978791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 81/172] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:19:06.259590 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:06.262561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:06.270285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:06.270791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:06.271234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:06.271930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:06.272370 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:06.272822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:06.442533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:06.448271 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:06.449594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:06.450872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3158d035-1289-483b-a3d3-48c31f7cc3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.195252 Sep 23 15:19:06.451477 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 92/173] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:06 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:06.457291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:06.457892 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:06.458505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:06.459430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:06.459951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:06.460418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:06.557646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:06.558258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:06.566416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:06.567928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:06.568372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:06.569140 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:06.569859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:06.570368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:06.615165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:06.624440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b676aef8-cb40-464b-aa32-bc5ba861bf55 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.180667 Sep 23 15:19:06.625246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 82/174] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:06 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:06.706687 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:06.715202 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:06.716670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:06.717789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d21f39ab-e9f3-4dbc-8caa-1588d3b99439 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.164459 Sep 23 15:19:06.718342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 93/175] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:06 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:06.756822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:06.757839 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:06.764485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:06.765383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:06.766113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:06.767154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:06.767729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:06.768189 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:06.912805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:06.921869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-27c9deb8-9113-46da-85b4-c191fd84236a tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.169407 Sep 23 15:19:06.924651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 83/176] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:06 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:07.474719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:07.475606 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:07.482173 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:07.482657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:07.483262 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:07.483963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:07.484561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:07.485016 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:07.647431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:07.648142 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:07.655237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:07.655958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:07.656666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:07.657540 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:07.658201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:07.658990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:07.666577 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:07.675224 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-31d60c8f-2670-40dd-9ac7-0a8cc453502f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.204352 Sep 23 15:19:07.675791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 94/177] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:07 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:07.743937 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:07.744573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:07.751689 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:07.752422 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:07.752898 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:07.753583 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:07.754214 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:07.754817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:07.799228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:07.807248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5e668357-ee93-4c6b-b6d2-cc7333a7f2ef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.163791 Sep 23 15:19:07.807835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 84/178] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:07 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:07.917395 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:07.927249 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:07.928757 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:07.929932 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2d22497a-bf7b-41cd-8d68-70bb91c328d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.191735 Sep 23 15:19:07.930824 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 95/179] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:07 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:07.946250 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:07.946868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:07.952982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:07.953499 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:07.953928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:07.954618 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:07.955093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:07.955518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:08.088199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:08.096318 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a28f6675-96e2-472a-8298-c37ebc38c6da tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1315 microversion: 2.1 time: 0.155124 Sep 23 15:19:08.114201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 85/180] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:07 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:08.701673 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:08.702277 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:08.721457 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:08.722369 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:08.723190 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:08.724221 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:08.724880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:08.725617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:08.830897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:08.832115 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:08.838988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:08.839587 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:08.840100 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:08.841081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:08.842201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:08.842634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:08.898081 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:08.902055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:08.908279 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-38a2e756-0ff5-4987-8bea-e429f4822ce6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.212667 Sep 23 15:19:08.908905 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 96/181] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:08 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:08.958951 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:08.960058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:08.969260 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:08.970008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:08.970605 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:08.971311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:08.971919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:08.972337 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:09.011439 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:09.025172 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-46f90fda-09e4-4290-bd66-3e5dc8007fe9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.196735 Sep 23 15:19:09.025172 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 86/182] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:08 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:09.121041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:09.122006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:09.131974 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:09.132484 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:09.132984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:09.136150 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:09.138156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:09.138877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:09.139939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:09.145641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:09.147317 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:09.148616 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-44b1943b-2347-43e5-ac8e-2a407c6fdea3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.194393 Sep 23 15:19:09.149581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 97/183] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:08 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:09.295914 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:09.304794 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f2ec3357-c9cd-4082-944e-7371f884e74d tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1502 microversion: 2.1 time: 0.188105 Sep 23 15:19:09.305368 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 87/184] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:09 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:09.830995 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-5ec5cb61-3d5a-4f06-a478-6edc63723e34 req-ea571a1f-5e54-420c-a992-8efb93c71753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95199f41-0774-4f39-912e-97a924ef09eb", "name": "network-vif-plugged", "status": "completed", "tag": "93652ce2-3bd3-4207-96bf-3c25e56c5c28"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:09.843137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-5ec5cb61-3d5a-4f06-a478-6edc63723e34 req-ea571a1f-5e54-420c-a992-8efb93c71753 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:09.843635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-5ec5cb61-3d5a-4f06-a478-6edc63723e34 req-ea571a1f-5e54-420c-a992-8efb93c71753 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:09.844063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-5ec5cb61-3d5a-4f06-a478-6edc63723e34 req-ea571a1f-5e54-420c-a992-8efb93c71753 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:09.856472 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-5ec5cb61-3d5a-4f06-a478-6edc63723e34 req-ea571a1f-5e54-420c-a992-8efb93c71753 service nova] Creating event network-vif-plugged:93652ce2-3bd3-4207-96bf-3c25e56c5c28 for instance 95199f41-0774-4f39-912e-97a924ef09eb on hv-cinder-85501 Sep 23 15:19:09.861525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-5ec5cb61-3d5a-4f06-a478-6edc63723e34 req-ea571a1f-5e54-420c-a992-8efb93c71753 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034943 Sep 23 15:19:09.862118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 98/185] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:19:09.935511 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:09.936151 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:09.942406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:09.942879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:09.943312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:09.943992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:09.944436 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:09.944895 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:10.049814 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:10.050500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:10.057692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:10.058175 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:10.058602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:10.059301 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:10.059752 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:10.060170 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:10.081621 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:10.090082 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5910029e-6743-4467-9590-3ccf9f48e174 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.158454 Sep 23 15:19:10.090645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 88/186] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:09 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:10.178105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:10.178859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:10.185514 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:10.185977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:10.186410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:10.187119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:10.187608 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:10.188033 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:10.197976 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:10.206414 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6d11dfff-92ad-485d-9818-006058c50a6b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.160861 Sep 23 15:19:10.207582 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 99/187] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:10 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:10.316947 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:10.325517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:10.326964 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:10.328045 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ea1e923f-9a95-443a-a66d-ed54a7beb081 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.153958 Sep 23 15:19:10.328633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 89/188] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:10 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:11.117060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:11.118111 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:11.124999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:11.125514 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:11.125970 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:11.126673 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:11.127177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:11.127621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:11.231232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:11.231944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:11.238577 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:11.239055 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:11.239486 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:11.240179 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:11.240652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:11.241070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:11.259391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:11.267295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-89247a47-b428-47b8-a079-1c11eda3487b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.157155 Sep 23 15:19:11.267870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 100/189] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:11 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:11.352922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:11.353527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:11.359769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:11.360258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:11.360704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:11.361396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:11.361849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:11.362272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:11.374948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:11.382878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-abe17777-09ac-496e-b3b0-0d9a00974661 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.155735 Sep 23 15:19:11.383466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 90/190] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:11 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:11.505750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:11.514360 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:11.515784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:11.516928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f6fca53d-dc27-4170-8cf4-657ed98b96fd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.168232 Sep 23 15:19:11.517483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 101/191] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:11 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:12.290752 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:12.291367 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:12.297782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:12.298425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:12.298859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:12.299547 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:12.300001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:12.300476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:12.406327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:12.406927 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:12.413767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:12.414245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:12.414710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:12.415480 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:12.415950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:12.416361 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:12.438361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:12.446268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-88e5ecd8-9795-41a9-996e-37939e2ae3d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.159733 Sep 23 15:19:12.450378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 91/192] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:12 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:12.543409 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:12.544387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:12.552610 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:12.553084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:12.553512 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:12.553661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:12.554212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:12.554663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:12.555069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:12.562445 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5bf3b0af-f93b-4313-80bd-bcee20e3f81d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.160480 Sep 23 15:19:12.563212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 102/193] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:12 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:12.689409 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:12.698572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:12.700007 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:12.701149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-151c4a7e-db5c-465f-847d-afc47d30f2a4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.162942 Sep 23 15:19:12.701706 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 92/194] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:12 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:13.469284 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:13.469889 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:13.476294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:13.476822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:13.477245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:13.477932 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:13.478378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:13.478776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:13.586123 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:13.586688 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:13.592931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:13.593439 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:13.593865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:13.594551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:13.594998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:13.595419 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:13.608981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:13.617223 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1cf916ef-abc8-45a9-96d5-51f7e3693d73 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.151857 Sep 23 15:19:13.617803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 103/195] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:13 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:13.726173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:13.730312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:13.731028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:13.734415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d90d07b2-d45b-4f34-82ce-7c39c31da241 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.152166 Sep 23 15:19:13.735001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 93/196] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:13 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:13.736924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:13.737397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:13.737827 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:13.738839 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:13.739279 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:13.739694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:13.892829 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:13.900837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:13.902662 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:13.903766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2a6270a9-0d1e-4f63-b5cd-d541f620eb2c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.177701 Sep 23 15:19:13.904658 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 104/197] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:13 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:14.641854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:14.642460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:14.648803 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:14.649291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:14.649723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:14.650419 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:14.650869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:14.651268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:14.759022 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:14.759613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:14.766758 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:14.767274 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:14.767707 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:14.768396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:14.768875 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:14.769425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:14.779414 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:14.787552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-dd14d756-f5e8-4ef5-a94b-5ceea83a614b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.149634 Sep 23 15:19:14.800686 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 94/198] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:14 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:14.907392 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:14.920844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-deadb2c3-3bd4-425f-8b93-19484791eb60 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.165625 Sep 23 15:19:14.921483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 105/199] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:14 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:14.937111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:14.937111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:14.937111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:14.938350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:14.938871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:14.939594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:14.940077 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:14.940546 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:14.959469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:15.091199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:15.099930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:15.101400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:15.102505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-703a8110-6bf6-4847-b6a1-03bd3a59bf95 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.177012 Sep 23 15:19:15.103063 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 95/200] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:14 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:15.812727 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:15.814369 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:15.822864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:15.823731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:15.824396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:15.825430 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:15.826126 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:15.826755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:15.945595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:15.945595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:15.961055 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:15.965099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:15.965533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:15.968538 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:15.969620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:15.969620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:16.056221 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:16.067377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cb9993d5-90dc-408e-8a95-7f2be97f5162 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.258279 Sep 23 15:19:16.068226 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 106/201] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:15 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:16.100366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41cb45ce-b85e-46e1-bd1f-891006688c17"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:16.102883 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:16.116796 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:16.116796 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:16.116796 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:16.116796 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:16.117088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:16.117088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:16.191193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:16.199650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a060d26e-68e4-4030-8cd7-c83ce4df05d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.259754 Sep 23 15:19:16.210969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 96/202] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:15 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:16.216455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:16.217123 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:16.223481 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:16.223962 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:16.224732 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:16.225410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:16.225892 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:16.226329 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:16.374023 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:16.382449 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:16.383904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:16.385045 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-540edb45-ea1b-4ca4-b175-9b1f7e6574f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.172948 Sep 23 15:19:16.385680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 97/203] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:16 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:17.093680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:17.093680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:17.098178 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:17.098653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:17.099079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:17.099753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:17.100202 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:17.100613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:17.249089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:17.256787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8b63d71f-ce9b-492a-9105-4fe753e7b1e5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.169638 Sep 23 15:19:17.257354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 98/204] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:17 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:17.270037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:17.270812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:17.276887 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:17.277323 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:17.277795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:17.278464 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:17.278904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:17.279314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:17.415894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:17.425112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7eb4e3e5-5c6e-4ffd-9d7d-cc8000409445 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.159280 Sep 23 15:19:17.426228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 99/205] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:17 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:17.431653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:17.432510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:17.439125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:17.439790 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:17.440397 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:17.441343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:17.441796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:17.442218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:17.584828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:17.594183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:17.595609 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:17.596759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d040bb4b-9d35-48e9-9a6f-24bc69087bc2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.169451 Sep 23 15:19:17.597391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 100/206] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:17 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:18.280133 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:18.280775 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:18.286811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.287290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.287714 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.288403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.288870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.289282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.419331 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:18.429360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-59648c21-b64e-4149-b674-337294a70a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.153490 Sep 23 15:19:18.429905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 101/207] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:18 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:18.449313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:18.450306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:18.456371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.456927 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.457360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.458222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.458672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.459249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.594504 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:18.602324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3a5ebe1b-6222-45d3-85c2-cd69fbd45d73 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.156996 Sep 23 15:19:18.602894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 102/208] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:18 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:18.622273 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:18.622873 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:18.629280 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.629760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.630231 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.630920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:18.631355 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:18.631779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:18.788988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:18.798034 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:18.799472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:18.800574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3a9f494e-5d9c-4e81-a849-9aa4bc2de393 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.182019 Sep 23 15:19:18.801177 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 103/209] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:18 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:19.458757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:19.459773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:19.470825 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:19.471617 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:19.472294 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:19.473419 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:19.474110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:19.474773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:19.610003 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:19.623804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-50e90005-16a3-4a27-9c4e-f020927d5220 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.174586 Sep 23 15:19:19.625019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 104/210] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:19 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:19.631836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:19.632789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:19.643421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:19.643839 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:19.644297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:19.645005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:19.645463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:19.645886 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:19.821571 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:19.831601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-85e97113-904c-4c1b-9280-4a9dbd8325c9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.205566 Sep 23 15:19:19.832193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 105/211] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:19 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:19.836811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:19.837417 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:19.844680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:19.845754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:19.846418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:19.847493 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:19.848229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:19.848966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:20.007290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:20.016373 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:20.017896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:20.019004 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-31f2bf32-f6dd-49a3-b78c-8a655628c789 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.185852 Sep 23 15:19:20.019567 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 106/212] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:19 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:20.651553 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:20.652237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:20.668102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:20.668640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:20.669112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:20.669850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:20.670317 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:20.670768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:20.817087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:20.825205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-605f345f-723d-4f71-b060-7e25f1105048 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.177558 Sep 23 15:19:20.825839 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 107/213] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:20 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:20.855657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:20.856174 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:20.862607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:20.863094 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:20.863844 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:20.864530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:20.865014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:20.865437 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:21.005492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:21.013510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-58c8fa78-6691-4e0e-afdb-fc3b9e682311 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.161605 Sep 23 15:19:21.014075 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 108/214] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:20 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:21.043188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:21.043840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:21.050317 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:21.050805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:21.051237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:21.051952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:21.052403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:21.052902 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:21.183982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:21.192893 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:21.194348 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:21.195456 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ff7e99cb-afd3-43d1-a58d-5581df844282 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.156092 Sep 23 15:19:21.196017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 109/215] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:21 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:21.847556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:21.848322 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:21.856743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:21.857239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:21.857698 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:21.858400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:21.858855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:21.859278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:22.011107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:22.019074 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0d2931cf-f9ba-4b94-b2b3-3f1392b9f506 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.175431 Sep 23 15:19:22.019648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 110/216] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:21 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:22.037690 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:22.038527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:22.046575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:22.047089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:22.047527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:22.048213 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:22.048694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:22.049123 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:22.190910 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:22.199024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b0a9f0a0-36be-49ac-970f-81098be81ff6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.166332 Sep 23 15:19:22.199749 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 111/217] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:22 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:22.221405 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:22.222014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:22.228856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:22.229350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:22.229780 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:22.230867 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:22.231472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:22.231983 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:22.236568 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:22.378160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:22.386326 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:22.388414 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:22.389530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b45cc86a-9746-4235-8529-9b35f5a01a8b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.172372 Sep 23 15:19:22.390070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 112/218] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:22 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:23.042553 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:23.043252 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:23.049728 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:23.050240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:23.050696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:23.051387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:23.051836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:23.052263 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:23.194079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:23.203682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8c53e9ec-81e7-4cbd-9eda-9ab52db8537a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.165259 Sep 23 15:19:23.204291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 113/219] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:23 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:23.222987 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:23.223698 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:23.230261 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:23.230955 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:23.231408 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:23.232337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:23.232831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:23.233253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:23.373770 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:23.382594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-21d59b17-456d-4831-8659-d835ed4a3233 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.163283 Sep 23 15:19:23.383283 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 114/220] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:23 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:23.414415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:23.415013 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:23.421544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:23.422019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:23.422439 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:23.423117 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:23.423596 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:23.423973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:23.559256 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:23.567309 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:23.568779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:23.569901 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f090b0af-8c76-4179-ae68-3fe39e1249c9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.159317 Sep 23 15:19:23.570437 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 115/221] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:23 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:24.226181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:24.226945 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:24.233157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:24.233634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:24.234058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:24.234737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:24.235179 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:24.235601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:24.366950 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:24.374801 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cc9386f0-a2ba-4fe6-9e70-d1c16123844b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.152644 Sep 23 15:19:24.375401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 116/222] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:24 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:24.407817 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:24.408511 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:24.414802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:24.415254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:24.415696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:24.416386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:24.416860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:24.417297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:24.555228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:24.563124 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-95905704-1240-482a-9194-4111a971a739 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.160249 Sep 23 15:19:24.563708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 117/223] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:24 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:24.594287 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:24.594895 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:24.600793 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:24.601274 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:24.601704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:24.602389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:24.602871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:24.603290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:24.733458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:24.742064 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:24.743541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:24.744823 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6d1b2ab8-59b9-4cf9-b299-323b0c0c5410 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.154287 Sep 23 15:19:24.745522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 118/224] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:24 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:25.401653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:25.402920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:25.409633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:25.410116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:25.410550 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:25.411242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:25.411695 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:25.412120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:25.549959 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:25.557898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-dbdaeecc-e261-494e-897b-45b0735b7d21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.162864 Sep 23 15:19:25.558923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 119/225] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:25 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:25.586287 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:25.586887 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:25.592922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:25.593373 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:25.593830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:25.594491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:25.595131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:25.595550 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:25.728118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:25.736198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7b83f7b8-f3e8-42b2-beb6-925fd3d1b456 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.153736 Sep 23 15:19:25.736773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 120/226] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:25 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:25.771998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:25.772517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:25.778895 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:25.779376 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:25.779803 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:25.780485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:25.780951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:25.781387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:25.912289 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:25.920811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:25.922234 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:25.923341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1e0c5480-0d5d-4f80-bb58-e774a1e1a7ba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.155131 Sep 23 15:19:25.923892 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 121/227] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:25 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:26.109187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=52 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:26.249806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=62 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:26.580964 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:26.581562 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:26.587959 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:26.588447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:26.588958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:26.589663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:26.590128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:26.590519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:26.723667 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:26.731413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8082de40-d52d-4566-9bf1-8339f3e3add1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.154422 Sep 23 15:19:26.732014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 122/228] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:26 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:26.759107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:26.759698 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:26.765944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:26.766415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:26.766837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:26.767523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:26.767962 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:26.768370 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:26.910583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:26.922399 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0e92a16a-6745-4d20-91e6-d85debca74fd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.166954 Sep 23 15:19:26.922993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 123/229] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:26 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:26.955244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:26.955837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:26.958777 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:26.962103 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:26.962591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:26.963001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:26.963680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:26.964122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:26.964534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:27.099371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:27.108838 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:27.110186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:27.111284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5a1a36a7-9b74-4a10-953e-357c5d24f409 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.159847 Sep 23 15:19:27.111878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 124/230] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:26 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:27.754774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:27.755450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:27.761611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:27.762162 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:27.762598 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:27.763285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:27.763736 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:27.764156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:27.893487 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:27.906324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f6c1690d-b9d2-4831-9ffb-558d3532c4be tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.155130 Sep 23 15:19:27.907081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 125/231] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:27 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:27.950009 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:27.950610 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:27.957603 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:27.958241 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:27.958932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:27.959995 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:27.960654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:27.961262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:28.115369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:28.125137 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-25d9c26e-d6e4-4082-8e41-d971f0ac6162 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.178902 Sep 23 15:19:28.125766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 126/232] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:27 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:28.137116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:28.137852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:28.144320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:28.144828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:28.145257 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:28.145951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:28.146400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:28.146827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:28.289266 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:28.298032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:28.299466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:28.300559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9e5711b7-b81d-4ce1-b7cb-860a29e34444 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.167713 Sep 23 15:19:28.301143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 127/233] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:28 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:28.937312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:28.938326 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:28.948462 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:28.949363 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:28.950281 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:28.950992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:28.951474 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:28.951900 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:29.085714 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:29.089224 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:29.094803 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2081909c-252c-4ac9-b6e8-36ebd033ddc3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.164102 Sep 23 15:19:29.095354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 128/234] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:28 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:29.148932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:29.149591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:29.156209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:29.156723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:29.157146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:29.157857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:29.158305 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:29.158719 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:29.302098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:29.311018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-40adb2c9-57ef-49ab-923d-3de28345258f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.166316 Sep 23 15:19:29.311587 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 129/235] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:29 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:29.325152 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:29.325777 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:29.332197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:29.332704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:29.333130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:29.333807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:29.334245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:29.334654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:29.463567 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:29.472032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:29.473495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:29.474604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-15cc4626-b56c-4e14-bc64-d056da9b0b20 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.153158 Sep 23 15:19:29.475167 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 130/236] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:29 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:30.118717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:30.119334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:30.125635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:30.126110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:30.126546 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:30.127244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:30.127713 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:30.128141 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:30.268222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:30.276308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d18dff22-98b9-4124-88ad-d1abdfb34a37 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.161444 Sep 23 15:19:30.276958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 131/237] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:30 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:30.337475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:30.338279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:30.348838 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:30.349722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:30.350383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:30.351435 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:30.352088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:30.352985 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:30.502760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:30.510966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a95d4c9d-db48-43c5-9f62-bf6d6df67f13 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.179442 Sep 23 15:19:30.511525 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 132/238] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:30 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:30.516103 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:30.516716 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:30.522374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:30.522847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:30.523272 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:30.523947 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:30.524385 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:30.524844 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:30.657149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:30.669651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:30.671595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:30.673314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8b26d2e2-0721-49d6-87b4-35ef4f738544 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.160543 Sep 23 15:19:30.674050 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 133/239] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:30 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:31.303234 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:31.304230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:31.312878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:31.313358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:31.313784 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:31.314463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:31.314980 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:31.315401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:31.457058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:31.466122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c59adba0-7c73-46c5-bdd7-51c8da8f46b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.169305 Sep 23 15:19:31.466864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 134/240] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:31 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:31.534720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:31.535338 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:31.541746 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:31.542237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:31.542673 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:31.543371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:31.543863 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:31.544649 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:31.685245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:31.693068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-14d042ff-9045-44a0-a054-400d93ca97ba tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.162360 Sep 23 15:19:31.693661 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 135/241] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:31 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:31.702255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:31.702857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:31.709249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:31.709735 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:31.710166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:31.710858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:31.711306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:31.711733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:31.850909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:31.859258 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:31.860733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:31.861853 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0650f9bd-3c73-4ecc-a828-1cf7de6900db tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.163752 Sep 23 15:19:31.862409 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 136/242] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:31 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:32.491624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:32.492242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:32.499188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:32.499779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:32.500217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:32.500948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:32.501409 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:32.501833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:32.642923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:32.650764 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7c530bef-0b5c-4dee-aaea-e5b41e80e911 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.163457 Sep 23 15:19:32.651369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 137/243] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:32 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:32.718767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:32.719367 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:32.725742 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:32.726228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:32.726661 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:32.727352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:32.727877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:32.728306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:32.890569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:32.899514 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-804426cc-b173-41a2-9859-4016735c8eb6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.184953 Sep 23 15:19:32.900179 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 138/244] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:32 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:32.905268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:32.906133 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:32.912740 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:32.913436 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:32.914081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:32.915205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:32.915734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:32.916204 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:33.033473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-006d545a-b87b-4de1-9ffe-df8e7707b9d4 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "POST /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.936942 Sep 23 15:19:33.042031 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 107/245] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:19:16 2022] POST /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061/os-volume_attachments => generated 194 bytes in 16944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:19:33.050890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-421bc09c-bd57-45de-8b09-58a6553a132a req-024ca154-027a-4090-9111-55bd5713113f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d9677f-fe5a-4549-91b7-4657540ae97f", "name": "network-vif-plugged", "status": "completed", "tag": "70760e9f-6d22-46eb-aa3e-f9e855dbf739"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:33.062672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-421bc09c-bd57-45de-8b09-58a6553a132a req-024ca154-027a-4090-9111-55bd5713113f service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:33.063150 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-421bc09c-bd57-45de-8b09-58a6553a132a req-024ca154-027a-4090-9111-55bd5713113f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:33.063562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-421bc09c-bd57-45de-8b09-58a6553a132a req-024ca154-027a-4090-9111-55bd5713113f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:33.067411 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:33.074602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-421bc09c-bd57-45de-8b09-58a6553a132a req-024ca154-027a-4090-9111-55bd5713113f service nova] Creating event network-vif-plugged:70760e9f-6d22-46eb-aa3e-f9e855dbf739 for instance a7d9677f-fe5a-4549-91b7-4657540ae97f on hv-cinder-85501 Sep 23 15:19:33.076342 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:33.078032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:33.079423 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-20aebc75-09b9-49dd-8d33-5755abc00fde tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.178035 Sep 23 15:19:33.079799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-421bc09c-bd57-45de-8b09-58a6553a132a req-024ca154-027a-4090-9111-55bd5713113f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033648 Sep 23 15:19:33.080206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 139/246] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:32 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:33.080520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 108/247] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:19:33.678093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:33.679185 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:33.688801 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:33.689325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:33.689778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:33.690536 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:33.691152 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:33.691660 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:33.884186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:33.899934 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-42db57b0-4f24-4010-b9d5-3235ce0f0c4b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.228272 Sep 23 15:19:33.900534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 140/248] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:33 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:33.930370 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:33.932427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:33.940427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:33.941004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:33.941437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:33.942130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:33.942597 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:33.943020 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:34.088933 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:34.096797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-0c7d4ffb-818b-4e0c-b458-fae398ac1688 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.176484 Sep 23 15:19:34.097364 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 109/249] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:33 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:34.106712 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:34.107402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:34.113884 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:34.114434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:34.114992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:34.115852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:34.116411 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:34.116941 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:34.249836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:34.258381 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:34.259845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:34.260986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6814b6b2-fc76-45d1-a5cf-23595060f9de tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.159730 Sep 23 15:19:34.261542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 141/250] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:34 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:34.927063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:34.928055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:34.939184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:34.939974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:34.940686 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:34.941838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:34.942573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:34.943265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:35.085425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:35.093552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a8f8af0a-e44e-4842-88ce-4982386d221c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.172948 Sep 23 15:19:35.094380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 110/251] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:34 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:35.120138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:35.120898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:35.129565 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:35.130062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:35.130494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:35.131195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:35.131648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:35.132069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:35.263339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:35.271112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-558da027-2602-4376-82a2-88acb0888625 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.155033 Sep 23 15:19:35.271685 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 142/252] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:35 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:35.286117 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:35.286712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:35.294425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:35.295075 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:35.295774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:35.296701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:35.297350 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:35.297942 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:35.433023 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:35.445603 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:35.447891 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:35.449819 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d9562c3e-3e2f-409a-927e-645c3250fcb8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.167323 Sep 23 15:19:35.450466 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 111/253] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:35 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:36.121727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:36.122727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:36.133523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:36.134300 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:36.135019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:36.136137 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:36.136927 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:36.137924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:36.273531 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:36.281551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a001bffd-31c9-47f8-9eec-05f5588f83df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.166396 Sep 23 15:19:36.282173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 143/254] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:36 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:36.293922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:36.295119 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:36.306256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:36.307035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:36.307555 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:36.308267 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:36.308750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:36.309174 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:36.447189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:36.455834 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-aab52038-1495-421e-9699-9ae9059569d6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1363 microversion: 2.1 time: 0.165796 Sep 23 15:19:36.456393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 112/255] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:36 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:36.475324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:36.475923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:36.482544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:36.483058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:36.483518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:36.484199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:36.484692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:36.485123 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:36.622879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:36.631790 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:36.633279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:36.634391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-88708f3c-fc05-42f1-b22d-d462cd73d42e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.163133 Sep 23 15:19:36.634946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 144/256] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:36 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:37.305748 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:37.306998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:37.318089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:37.318802 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:37.319432 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:37.320277 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:37.321133 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:37.321946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:37.457152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:37.464961 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c992801f-2029-4ce0-8ff9-3c6bf9d2a18d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.163818 Sep 23 15:19:37.465565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 113/257] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:37 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:37.479343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:37.479850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:37.486315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:37.486785 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:37.487207 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:37.487890 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:37.488354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:37.489133 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:37.506936 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:37.619743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:37.627808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b4a716e0-81b6-4898-9d70-74d5a257a486 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1549 microversion: 2.1 time: 0.152396 Sep 23 15:19:37.628403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 145/258] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:37 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:37.651227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:37.651715 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:37.658391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:37.658874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:37.659306 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:37.659404 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:37.659961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:37.660059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:37.660458 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:37.660924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:37.665997 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:37.666485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:37.666921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:37.667619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:37.668072 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:37.668498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:37.744993 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9704222f-f28c-4a30-988f-048e7ec6e3c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097668 Sep 23 15:19:37.745723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 114/259] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Sep 23 15:19:37 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:19:37.802424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:37.810814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:37.812437 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:37.813577 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9a7023d7-c319-49c4-b2e1-8a3fb53cb766 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1406 microversion: 2.20 time: 0.158280 Sep 23 15:19:37.814137 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 146/260] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:37 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:19:38.490113 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:38.491725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:38.499242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:38.499873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:38.500377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:38.501211 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:38.501834 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:38.502462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:38.838852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:38.840155 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:38.847308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:38.848022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:38.848665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:38.849718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:38.850156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:38.850597 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:38.938561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:38.947517 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a0d18611-4b4f-43d4-b6c2-6d5a0991b6e2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.463558 Sep 23 15:19:38.948676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 115/261] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:38 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:39.010573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:39.022135 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:39.023802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:39.025614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1ade1e0a-8313-4620-9d57-985a7b68f5d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1598 microversion: 2.20 time: 0.190067 Sep 23 15:19:39.026938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 147/262] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:19:38 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1598 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:19:39.054937 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:39.055602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:39.062111 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:39.062874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:39.063515 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:39.064443 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:39.064963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:39.065402 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:39.207045 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-391ceec0-49c8-4aa1-a1d7-3f2600c74672 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.153986 Sep 23 15:19:39.207045 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 116/263] 10.222.0.75 () {60 vars in 1316 bytes} [Fri Sep 23 15:19:39 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:19:39.452963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-aa9bffed-737f-4354-96ac-1872b9abfa24 req-f4146663-a3af-4f5c-919c-1a0553d7493f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b92954-0cb5-4c21-ab67-8f80c5be9eb9", "tag": "5073b565-7790-42c1-a11b-5c4328b5da4a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:39.476713 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-aa9bffed-737f-4354-96ac-1872b9abfa24 req-f4146663-a3af-4f5c-919c-1a0553d7493f service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:39.477416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-aa9bffed-737f-4354-96ac-1872b9abfa24 req-f4146663-a3af-4f5c-919c-1a0553d7493f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:39.478954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-aa9bffed-737f-4354-96ac-1872b9abfa24 req-f4146663-a3af-4f5c-919c-1a0553d7493f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:39.495463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-aa9bffed-737f-4354-96ac-1872b9abfa24 req-f4146663-a3af-4f5c-919c-1a0553d7493f service nova] Creating event network-changed:5073b565-7790-42c1-a11b-5c4328b5da4a for instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 on hv-cinder-85501 Sep 23 15:19:39.507454 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-aa9bffed-737f-4354-96ac-1872b9abfa24 req-f4146663-a3af-4f5c-919c-1a0553d7493f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060399 Sep 23 15:19:39.508219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 148/264] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:19:39.972115 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:39.973028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:39.979234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:39.979857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:39.980407 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:39.981401 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:39.982131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:39.983396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:40.155606 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:40.163882 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-522b1926-335a-4578-8cfd-f7112263068f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.196738 Sep 23 15:19:40.173984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 117/265] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:39 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:40.684520 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-2332d336-fd62-43e7-a326-75e2fddc1571 req-e3493976-1e44-46c4-bac7-0c688df11177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95199f41-0774-4f39-912e-97a924ef09eb", "tag": "93652ce2-3bd3-4207-96bf-3c25e56c5c28"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:40.703653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-2332d336-fd62-43e7-a326-75e2fddc1571 req-e3493976-1e44-46c4-bac7-0c688df11177 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:40.704738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-2332d336-fd62-43e7-a326-75e2fddc1571 req-e3493976-1e44-46c4-bac7-0c688df11177 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:40.705176 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-2332d336-fd62-43e7-a326-75e2fddc1571 req-e3493976-1e44-46c4-bac7-0c688df11177 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:40.719822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-2332d336-fd62-43e7-a326-75e2fddc1571 req-e3493976-1e44-46c4-bac7-0c688df11177 service nova] Creating event network-changed:93652ce2-3bd3-4207-96bf-3c25e56c5c28 for instance 95199f41-0774-4f39-912e-97a924ef09eb on hv-cinder-85501 Sep 23 15:19:40.725571 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-2332d336-fd62-43e7-a326-75e2fddc1571 req-e3493976-1e44-46c4-bac7-0c688df11177 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045703 Sep 23 15:19:40.726756 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 149/266] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:19:41.188823 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:41.189591 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:41.197981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:41.199301 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:41.200461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:41.202321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:41.203164 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:41.203855 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:41.477666 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:41.490295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cf921bc3-535e-4587-b1b9-56dcf4f88883 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1321 microversion: 2.1 time: 0.306275 Sep 23 15:19:41.501165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 118/267] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:41 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:42.514210 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:42.515627 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:42.522378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:42.522984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:42.523609 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:42.525032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:42.525490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:42.525905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:42.779076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:42.792771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4d3ef706-a688-4ea8-bc90-80cd8f7c84ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1514 microversion: 2.1 time: 0.281942 Sep 23 15:19:42.794156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 150/268] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:42 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:42.821394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:42.823763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:42.831084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:42.831875 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:42.832517 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:42.833499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:42.834139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:42.834847 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:42.872950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'flavor' on Instance uuid a7d9677f-fe5a-4549-91b7-4657540ae97f {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:19:43.025544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1cbf80ca-413f-4011-baa5-e651e7eb8ff4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f/action" status: 200 len: 32 microversion: 2.1 time: 0.209839 Sep 23 15:19:43.026165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 119/269] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:19:42 2022] POST /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:19:43.036361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:43.037232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:43.045639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:43.046230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:43.046729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:43.047467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:43.047957 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:43.048670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:43.197542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:43.208222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7b5ec5f8-530a-4ae4-b753-21dc90b4499a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.175756 Sep 23 15:19:43.223618 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 151/270] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:43 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:44.232946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:44.233809 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:44.241387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:44.241844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:44.242486 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:44.243383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:44.243836 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:44.244259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:44.375876 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:44.384710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dbbd3a60-bbfa-48b4-bad5-a04130ca1d60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.156892 Sep 23 15:19:44.385284 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 120/271] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:44 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:45.407682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:45.408314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:45.414807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:45.415356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:45.415911 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:45.416699 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:45.417194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:45.417684 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:45.554880 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:45.563392 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2b0542ce-bda9-4019-ab6a-b1fee34e1e92 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.159853 Sep 23 15:19:45.564028 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 152/272] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:45 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:46.586924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:46.587544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:46.594770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:46.595245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:46.595678 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:46.596359 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:46.596846 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:46.597269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:46.738859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:46.747127 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dca19d41-2327-452f-9b79-7693f9f7cb12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.164194 Sep 23 15:19:46.747726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 121/273] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:46 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:47.770977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:47.771575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:47.778190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:47.778672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:47.779096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:47.779781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:47.780313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:47.780867 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:47.925659 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:47.933551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6f02936c-a6d1-4115-88f0-8af52a955f48 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.166505 Sep 23 15:19:47.934117 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 153/274] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:47 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:48.957544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:48.958169 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:48.965105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:48.965586 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:48.966016 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:48.966705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:48.967159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:48.967581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:48.986065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:49.103202 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:49.111171 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b30c3cd7-996c-4379-b631-81e3eb6ed233 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.157563 Sep 23 15:19:49.111791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 122/275] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:48 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:50.134969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:50.135572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:50.141849 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:50.142333 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:50.142794 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:50.143493 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:50.143946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:50.144371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:50.275055 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:50.284176 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f33c5d84-ba01-4107-a544-49e559ed718a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.153367 Sep 23 15:19:50.284789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 154/276] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:50 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:51.307039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:51.307506 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:51.314641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:51.315128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:51.315778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:51.316723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:51.317387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:51.318014 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:51.467503 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:51.477304 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2d638bb3-f5a6-450b-a9c5-eb360532c59b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.174332 Sep 23 15:19:51.494244 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 123/277] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:51 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:52.502767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:52.503656 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:52.511099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:52.511796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:52.512417 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:52.513444 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:52.514338 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:52.514772 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:52.663604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:52.672124 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9d7a1b2a-05a3-4728-8020-001212cea139 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.173524 Sep 23 15:19:52.673027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 155/278] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:52 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:52.695648 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:52.696143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:52.702723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:52.703042 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:52.703478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:52.704281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:52.704818 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:52.705248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:52.731770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:19:52.836168 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3fc58427-b1c7-48b0-8838-0a19722372a0 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "DELETE /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 204 len: 0 microversion: 2.1 time: 0.144050 Sep 23 15:19:52.836958 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 124/279] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:19:52 2022] DELETE /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:19:52.846169 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:52.847231 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:52.874732 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:52.885960 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:52.888175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:52.889095 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:52.890604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:52.893079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:53.096314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:53.112877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3c5a12da-9975-42a8-b9a2-8d1c598612ef tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1554 microversion: 2.1 time: 0.270857 Sep 23 15:19:53.113973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 156/280] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:52 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1554 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:53.698598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:53.701974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:53.726561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:53.728757 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:53.729997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:53.730928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:53.732117 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:53.732791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:54.103690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:54.115990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-76f742f1-60fa-497a-ace2-556675ad5669 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.424885 Sep 23 15:19:54.116723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 125/281] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:53 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:54.138225 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:54.138822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:54.145766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:54.146265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:54.146700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:54.147477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:54.148129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:54.148552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:54.328657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:54.338858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-35b37582-9af8-4ab0-92ad-d181bbee84ea tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1554 microversion: 2.1 time: 0.204672 Sep 23 15:19:54.339619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 157/282] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:54 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:55.139983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:55.141368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:55.149511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:55.150035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:55.150422 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:55.151138 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:55.151872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:55.152470 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:55.339781 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:55.349103 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f9f1b437-33af-4244-81e9-9c97b4df7d36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.213084 Sep 23 15:19:55.350544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 126/283] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:55 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:55.366783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:55.367591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:55.374074 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:55.374808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:55.375432 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:55.376659 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:55.377478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:55.378105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:55.639327 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:55.650109 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-319999d0-0f45-4203-97ac-cc81bcb10fc9 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1554 microversion: 2.1 time: 0.287110 Sep 23 15:19:55.669900 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 158/284] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:55 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:56.374025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:56.375379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:56.379677 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:56.384767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:56.385524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:56.386040 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:56.387355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:56.388093 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:56.388844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:56.627842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-5f4f6a08-382b-44ea-a8fe-855d92b04f4b req-588a85a7-e023-450b-9eb2-b0a7fb0cf921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "388c3ec1-6dc6-44b8-b711-58a0cf68f061", "name": "network-vif-deleted", "tag": "e1def8de-4010-4053-8bd1-c1cc1548cb27"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:56.639734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5f4f6a08-382b-44ea-a8fe-855d92b04f4b req-588a85a7-e023-450b-9eb2-b0a7fb0cf921 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:56.640314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5f4f6a08-382b-44ea-a8fe-855d92b04f4b req-588a85a7-e023-450b-9eb2-b0a7fb0cf921 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:56.640858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5f4f6a08-382b-44ea-a8fe-855d92b04f4b req-588a85a7-e023-450b-9eb2-b0a7fb0cf921 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:56.663466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-5f4f6a08-382b-44ea-a8fe-855d92b04f4b req-588a85a7-e023-450b-9eb2-b0a7fb0cf921 service nova] Creating event network-vif-deleted:e1def8de-4010-4053-8bd1-c1cc1548cb27 for instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 on hv-cinder-85501 Sep 23 15:19:56.669909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-5f4f6a08-382b-44ea-a8fe-855d92b04f4b req-588a85a7-e023-450b-9eb2-b0a7fb0cf921 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045919 Sep 23 15:19:56.678842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 159/285] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:19:56.685909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:56.687008 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:56.694274 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:56.695097 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:56.695822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:56.697014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:56.697696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:56.698382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:56.783555 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:56.798666 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bb3c4f01-0e74-4c5d-80d8-4fcf13cd45f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.428946 Sep 23 15:19:56.805272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 127/286] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:56 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:56.846422 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:56.860249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-748f99cd-5b6f-4ce3-9c25-0d7989c86dd7 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1346 microversion: 2.1 time: 0.178169 Sep 23 15:19:56.864821 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 160/287] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:56 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1346 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:57.826367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:57.826965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:57.833797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:57.834283 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:57.834723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:57.835415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:57.835866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:57.836286 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:57.890948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:57.891882 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:57.894055 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=73 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:19:57.899497 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:57.900166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:57.900853 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:57.901814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:57.902340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:57.902810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:57.940701 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:57.941296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:57.941768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:57.942232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lazy-loading 'fault' on Instance uuid 388c3ec1-6dc6-44b8-b711-58a0cf68f061 {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:19:57.994492 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:58.005961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a568b6fd614744abaf5ca41fb26c1f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f632ecb8ee4e6fb59978560789f599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:58.008804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bea1292b-f60f-4578-b984-ec8242728ea3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.185773 Sep 23 15:19:58.015617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 128/288] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:57 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:58.015880 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-da4c419c-3a29-4f0f-8ef0-6b2c6b809363 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 200 len: 1351 microversion: 2.1 time: 0.128874 Sep 23 15:19:58.016885 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 161/289] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:57 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:19:58.145455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1942234636", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "networks": [{"uuid": "c67c26da-b776-4386-b438-d1ea6d9daf36"}]}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:19:58.209482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] validate_networks() for [('c67c26da-b776-4386-b438-d1ea6d9daf36', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:19:58.611311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:19:58.611734 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:19:58.612207 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:19:58.612631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:19:58.613046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:19:58.622646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:58.623129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:58.623562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:58.628755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:58.628755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:58.628755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:58.643084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Getting quotas for project efa8ccdc30dc4651b730950a0a5fe8d4. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:19:58.647036 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Getting quotas for user 159528b6ad49481f86bfbbac6187d584 and project efa8ccdc30dc4651b730950a0a5fe8d4. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:19:58.658529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:19:58.660819 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:19:58.716145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-32eddff8-1529-4a2b-9a6f-508e9a071538 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574499 Sep 23 15:19:58.716952 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 129/290] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:19:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:19:58.731147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-92cb2c86-401c-4908-a5a4-60960442456f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:58.731147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-92cb2c86-401c-4908-a5a4-60960442456f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:58.787544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-92cb2c86-401c-4908-a5a4-60960442456f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:58.796226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-92cb2c86-401c-4908-a5a4-60960442456f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1214 microversion: 2.1 time: 0.071376 Sep 23 15:19:58.797139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 162/291] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:58 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:59.035839 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:59.037139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:59.047254 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:59.048536 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:59.052399 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:59.052399 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:59.053726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:59.054594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:59.055488 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:59.056421 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:59.060684 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:59.061400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:59.061855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:59.062554 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:59.062995 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:59.064283 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:59.100087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] HTTP exception thrown: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Request method failure captured: Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 HTTP/1.1 Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc40GlkBl8KxTcXQoQ8PPaWH2FxHQVal8SoqS83SYcM3BAZLn9V9GMEXTkcAhvLFvRDq_PAEnbLvvPocrzxoRgagE49joJGRrQPzkZOXANEH87zpRYDLtofDuD7ubaGs5aqj9GufkPvgGt8Wk1J2tTqxjkSN_29J-UTBi90qwNTN0I0 Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: b0f632ecb8ee4e6fb59978560789f599 Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-DeleteServersTestJSON-381200369 Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:19:59.115445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b0f632ecb8ee4e6fb59978560789f599"}]}] Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-DeleteServersTestJSON-381200369 Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: b0f632ecb8ee4e6fb59978560789f599 Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-DeleteServersTestJSON-381200369 Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-DeleteServersTestJSON-381200369-project Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: a568b6fd614744abaf5ca41fb26c1f13 Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-DeleteServersTestJSON-381200369-project Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.116782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '388c3ec1-6dc6-44b8-b711-58a0cf68f061'} Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:19:59.117467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.118653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.122577 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Returning 404 to user: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:19:59.123624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b0fd2222-7e4f-4d34-8368-510021703bde tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 404 len: 111 microversion: 2.1 time: 0.077794 Sep 23 15:19:59.125354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 163/292] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:59 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:19:59.227081 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:59.236043 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4f2e60a0-e545-41ed-9828-9561d4b1c7bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.208142 Sep 23 15:19:59.236880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 130/293] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:59 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:19:59.257352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:59.259624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:59.265761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:59.266524 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:59.266963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:59.267676 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:59.269039 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:59.269228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:59.330542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] HTTP exception thrown: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Request method failure captured: Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061/os-volume_attachments HTTP/1.1 Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc40GlkBl8KxTcXQoQ8PPaWH2FxHQVal8SoqS83SYcM3BAZLn9V9GMEXTkcAhvLFvRDq_PAEnbLvvPocrzxoRgagE49joJGRrQPzkZOXANEH87zpRYDLtofDuD7ubaGs5aqj9GufkPvgGt8Wk1J2tTqxjkSN_29J-UTBi90qwNTN0I0 Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: b0f632ecb8ee4e6fb59978560789f599 Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-DeleteServersTestJSON-381200369 Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:19:59.332136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b0f632ecb8ee4e6fb59978560789f599"}]}] Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-DeleteServersTestJSON-381200369 Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: b0f632ecb8ee4e6fb59978560789f599 Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-DeleteServersTestJSON-381200369 Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-DeleteServersTestJSON-381200369-project Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: a568b6fd614744abaf5ca41fb26c1f13 Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-DeleteServersTestJSON-381200369-project Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.333442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'server_id': '388c3ec1-6dc6-44b8-b711-58a0cf68f061'} Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:19:59.334105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:19:59.335134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:19:59.337156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Returning 404 to user: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:19:59.337156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-98a9476c-09f6-44de-99a5-871afbd8ac84 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.080781 Sep 23 15:19:59.337156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 164/294] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:19:59 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:19:59.824403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:19:59.825386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:19:59.833668 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:59.834228 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:59.834712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:59.835732 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:19:59.836165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:19:59.836877 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:19:59.933886 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:19:59.943034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b5259e2f-2ce4-4871-aaf9-f7bef81daae1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1266 microversion: 2.1 time: 0.124273 Sep 23 15:19:59.945103 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 131/295] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:19:59 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:00.264088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:00.264717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:00.273008 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:00.273727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:00.274188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:00.275247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:00.275880 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:00.276278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:00.477940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:00.487027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-09085443-0427-4c46-b78d-0d7e7f4fe032 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.227046 Sep 23 15:20:00.488654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 165/296] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:00 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:00.574817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:00.575487 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:00.582940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:00.583820 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:00.584438 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:00.585948 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:00.586578 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:00.587005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:00.604997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] HTTP exception thrown: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Request method failure captured: Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: DELETE /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 HTTP/1.1 Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc40GlkBl8KxTcXQoQ8PPaWH2FxHQVal8SoqS83SYcM3BAZLn9V9GMEXTkcAhvLFvRDq_PAEnbLvvPocrzxoRgagE49joJGRrQPzkZOXANEH87zpRYDLtofDuD7ubaGs5aqj9GufkPvgGt8Wk1J2tTqxjkSN_29J-UTBi90qwNTN0I0 Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: b0f632ecb8ee4e6fb59978560789f599 Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-DeleteServersTestJSON-381200369 Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:20:00.611676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b0f632ecb8ee4e6fb59978560789f599"}]}] Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-DeleteServersTestJSON-381200369 Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: b0f632ecb8ee4e6fb59978560789f599 Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-DeleteServersTestJSON-381200369 Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-DeleteServersTestJSON-381200369-project Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: a568b6fd614744abaf5ca41fb26c1f13 Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-DeleteServersTestJSON-381200369-project Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.612982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '388c3ec1-6dc6-44b8-b711-58a0cf68f061'} Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:00.613645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.615335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.617472 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Returning 404 to user: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:00.617472 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-303d2fd5-7786-49b9-8eea-e839dc8f24d1 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "DELETE /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 404 len: 111 microversion: 2.1 time: 0.043166 Sep 23 15:20:00.617472 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 132/297] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:20:00 2022] DELETE /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:20:00.624688 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:00.625312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] [instance: 388c3ec1-6dc6-44b8-b711-58a0cf68f061] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:00.631992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:00.632897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:00.633501 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:00.634307 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:00.634989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:00.635467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:00.641969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:00.652491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] HTTP exception thrown: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Request method failure captured: Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 HTTP/1.1 Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc40GlkBl8KxTcXQoQ8PPaWH2FxHQVal8SoqS83SYcM3BAZLn9V9GMEXTkcAhvLFvRDq_PAEnbLvvPocrzxoRgagE49joJGRrQPzkZOXANEH87zpRYDLtofDuD7ubaGs5aqj9GufkPvgGt8Wk1J2tTqxjkSN_29J-UTBi90qwNTN0I0 Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: b0f632ecb8ee4e6fb59978560789f599 Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-DeleteServersTestJSON-381200369 Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:20:00.654110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b0f632ecb8ee4e6fb59978560789f599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b0f632ecb8ee4e6fb59978560789f599"}]}] Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-DeleteServersTestJSON-381200369 Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: b0f632ecb8ee4e6fb59978560789f599 Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-DeleteServersTestJSON-381200369 Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-DeleteServersTestJSON-381200369-project Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: a568b6fd614744abaf5ca41fb26c1f13 Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-DeleteServersTestJSON-381200369-project Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.655296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '388c3ec1-6dc6-44b8-b711-58a0cf68f061'} Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:00.655948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. Sep 23 15:20:00.658242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:20:00.659544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] Returning 404 to user: Instance 388c3ec1-6dc6-44b8-b711-58a0cf68f061 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:00.659544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-641c2b8b-462f-40de-81e4-344d3c732411 tempest-DeleteServersTestJSON-381200369 tempest-DeleteServersTestJSON-381200369-project] 10.222.0.75 "GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061" status: 404 len: 111 microversion: 2.1 time: 0.035546 Sep 23 15:20:00.659544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 166/298] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:00 2022] GET /compute/v2.1/servers/388c3ec1-6dc6-44b8-b711-58a0cf68f061 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:20:00.968286 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:00.969541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:00.977204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:00.978483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:00.979143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:00.980293 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:00.981748 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:00.982339 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:01.115394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:01.123939 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e5782480-0983-41a2-97c9-4c8d326d7ac1 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1272 microversion: 2.1 time: 0.160173 Sep 23 15:20:01.124955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 133/299] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:00 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:01.516931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:01.518307 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:01.527478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:01.528387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:01.529148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:01.530072 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:01.530671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:01.531298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:01.758723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:01.769114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8a42b86f-a035-40bf-bf43-0a0d03e04121 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.261179 Sep 23 15:20:01.784892 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 167/300] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:01 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:02.148676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:02.149410 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:02.159053 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:02.161869 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:02.162335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:02.165857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:02.166537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:02.167124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:02.497382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-0ecfd135-3f67-4c51-84e6-ef2f7e1d7cdb req-e6a891f8-5752-4093-a119-b7493f0b4705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8396993-2f10-4ec4-9745-8bbd605eeb9f", "tag": "6f854937-824a-480d-a6f0-47591ff1371b"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:02.512938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-0ecfd135-3f67-4c51-84e6-ef2f7e1d7cdb req-e6a891f8-5752-4093-a119-b7493f0b4705 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:02.513422 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-0ecfd135-3f67-4c51-84e6-ef2f7e1d7cdb req-e6a891f8-5752-4093-a119-b7493f0b4705 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:02.513856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-0ecfd135-3f67-4c51-84e6-ef2f7e1d7cdb req-e6a891f8-5752-4093-a119-b7493f0b4705 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:02.529926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-0ecfd135-3f67-4c51-84e6-ef2f7e1d7cdb req-e6a891f8-5752-4093-a119-b7493f0b4705 service nova] Creating event network-changed:6f854937-824a-480d-a6f0-47591ff1371b for instance a8396993-2f10-4ec4-9745-8bbd605eeb9f on hv-cinder-85501 Sep 23 15:20:02.536569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-0ecfd135-3f67-4c51-84e6-ef2f7e1d7cdb req-e6a891f8-5752-4093-a119-b7493f0b4705 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042749 Sep 23 15:20:02.537750 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 168/301] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:20:02.558897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:02.572272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-59db13f5-27af-4ce6-bfb6-49cd4187184f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.428126 Sep 23 15:20:02.572909 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 134/302] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:02 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:02.795212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:02.796194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:02.816394 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:02.818780 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:02.819231 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:02.819996 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:02.820455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:02.821696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:03.048403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:03.060405 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3dfa98cf-e401-4d8b-b517-e7c21cd47e67 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.270465 Sep 23 15:20:03.076631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 169/303] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:02 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:03.596835 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:03.597444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:03.604400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:03.604916 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:03.605352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:03.606047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:03.606667 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:03.607224 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:03.766077 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:03.780399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f6ceee15-7d0d-4836-82f9-cd695bf6ff16 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.187750 Sep 23 15:20:03.781363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 135/304] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:03 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:04.088154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:04.089298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:04.096066 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:04.100635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:04.101337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:04.102231 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:04.102703 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:04.103153 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:04.319725 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:04.329532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3a3d17ec-9836-483d-b5e8-3083f7e99367 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.244736 Sep 23 15:20:04.333743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 170/305] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:04 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:04.804086 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:04.805843 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:04.825228 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:04.825622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:04.826252 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:04.827028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:04.827485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:04.827908 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:05.086410 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:05.095239 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-492d4836-3427-4cde-bee8-d077a462377a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.295679 Sep 23 15:20:05.095952 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 136/306] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:04 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:05.352655 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:05.353322 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:05.368323 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:05.368706 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:05.370115 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:05.370983 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:05.371607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:05.372186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:05.524498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:05.532939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9088cd00-5147-44e8-a811-43c310f1e7d0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.184300 Sep 23 15:20:05.538848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 171/307] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:05 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:06.118703 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:06.119527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:06.127132 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:06.127462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:06.127864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:06.128561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:06.129202 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:06.129806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:06.276265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:06.286302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b30a48fb-1aac-4a45-a4e0-1741eac191b5 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.171125 Sep 23 15:20:06.287185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 137/308] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:06 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:06.562861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:06.564461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:06.570991 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:06.571977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:06.572650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:06.578580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:06.579559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:06.580069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:06.745735 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:06.757580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6d022f3e-88e0-4d94-b0bd-3e1c1d5bd1c2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.198555 Sep 23 15:20:06.758161 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 172/309] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:06 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:07.310025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:07.311191 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:07.320776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:07.320776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:07.320776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:07.320776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:07.321068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:07.321068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:07.513621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:07.517943 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:07.523024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a760ddd8-ced1-4816-98af-c5b32b3a2419 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.217214 Sep 23 15:20:07.526931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 138/310] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:07 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:07.782517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:07.783386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:07.791119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:07.791820 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:07.792681 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:07.793495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:07.794188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:07.794674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:07.935374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:07.944693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a63a448d-cae5-47b5-858a-972d47ae5927 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.167838 Sep 23 15:20:07.945627 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 173/311] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:07 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:08.547817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:08.548875 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:08.560512 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:08.561176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:08.561708 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:08.562603 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:08.563164 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:08.563900 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:08.633658 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:08.657877 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:08.712287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:08.724714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5d00b30e-6bb7-4664-a8dc-13d97080957c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.181563 Sep 23 15:20:08.725638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 139/312] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:08 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:08.967586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:08.968992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:08.977907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:08.980390 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:08.981203 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:08.981863 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:08.982638 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:08.983308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:08.983764 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:09.183968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:09.193410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d9e81ca3-f332-4e2b-b5cb-b2d4621a86b9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.229634 Sep 23 15:20:09.194230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 174/313] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:08 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:09.749285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:09.750277 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:09.759264 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:09.760160 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:09.760803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:09.761719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:09.762351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:09.762785 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:09.930161 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:09.938778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4992eedc-330f-4220-ab04-81743dc5801e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.193657 Sep 23 15:20:09.939378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 140/314] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:09 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:10.217983 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:10.218791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:10.231510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:10.232855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:10.233770 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:10.236312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:10.237097 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:10.237858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:10.402906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:10.412243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3be0311f-a6fe-4533-b8d9-bf27247944fd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.199411 Sep 23 15:20:10.413751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 175/315] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:10 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:10.963082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:10.964077 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:10.971726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:10.972220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:10.972698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:10.973584 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:10.974091 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:10.974698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:11.159838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:11.168087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-55e16c39-6a1f-44e0-96dc-94d2c4619b01 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.210246 Sep 23 15:20:11.168978 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 141/316] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:10 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:11.439232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:11.440125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:11.451488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:11.452261 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:11.453237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:11.455588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:11.457114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:11.458710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:11.604343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:11.614877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a561a3c9-0ece-4687-9378-cca6dacec1d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.179824 Sep 23 15:20:11.616039 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 176/317] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:11 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:12.191845 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:12.192578 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:12.199131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:12.199610 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:12.200047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:12.200763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:12.201245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:12.201666 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:12.427880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:12.436446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2b16e8b8-779e-4864-bc64-1dae11831bfe tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.248819 Sep 23 15:20:12.437059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 142/318] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:12 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:12.640617 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:12.641334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:12.648352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:12.648870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:12.649553 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:12.650697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:12.651549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:12.652125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:12.803126 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:12.811119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-50b3103b-eb6d-4236-b656-0188c8336bfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.174524 Sep 23 15:20:12.821888 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 177/319] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:12 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:13.464210 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:13.465550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:13.472826 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:13.473316 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:13.473772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:13.474720 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:13.475172 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:13.475592 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:13.751680 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:13.761521 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9aa1fb93-e35e-4b91-804e-753c67a3cdee tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.300931 Sep 23 15:20:13.762435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 143/320] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:13 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:13.835966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:13.836885 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:13.844307 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:13.845177 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:13.846025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:13.846976 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:13.847772 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:13.848396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:14.003741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:14.012801 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c5503f9c-212e-4f61-9a66-13d1d1067752 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.181555 Sep 23 15:20:14.013991 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 178/321] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:13 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:14.785993 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:14.786626 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:14.801487 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:14.802036 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:14.802482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:14.803207 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:14.803702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:14.804083 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:15.036900 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:15.038291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:15.045378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:15.046146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:15.046757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:15.047866 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:15.048580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:15.049264 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:15.168982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:15.185879 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c95c7a77-bbcf-45dc-84a5-07ef328f8555 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.404431 Sep 23 15:20:15.202190 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 144/322] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:14 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:15.410220 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:15.420317 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-64966f6a-45ae-48de-8eed-bb0b89d2f4f5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.387427 Sep 23 15:20:15.420938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 179/323] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:15 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:16.211344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:16.212305 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:16.222526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:16.223257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:16.223894 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:16.225077 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:16.225709 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:16.226489 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:16.419405 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:16.430741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-de55376c-f6da-4a78-8f8d-4b8036b90d0d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.223959 Sep 23 15:20:16.432399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 145/324] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:16 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:16.448381 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:16.449110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:16.460722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:16.461520 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:16.462270 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:16.463678 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:16.464359 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:16.465006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:16.703428 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:16.717554 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e74de0f1-013f-4707-8c6e-7c1adb00f529 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.272352 Sep 23 15:20:16.729898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 180/325] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:16 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:17.418462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-d1396aa1-f320-45d9-adde-9b3a00351e05 req-1547ea2e-2a8a-405f-b22c-6fe83497408d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8396993-2f10-4ec4-9745-8bbd605eeb9f", "name": "network-vif-plugged", "status": "completed", "tag": "6f854937-824a-480d-a6f0-47591ff1371b"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:17.433950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d1396aa1-f320-45d9-adde-9b3a00351e05 req-1547ea2e-2a8a-405f-b22c-6fe83497408d service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:17.434420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d1396aa1-f320-45d9-adde-9b3a00351e05 req-1547ea2e-2a8a-405f-b22c-6fe83497408d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:17.456852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d1396aa1-f320-45d9-adde-9b3a00351e05 req-1547ea2e-2a8a-405f-b22c-6fe83497408d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:17.463277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:17.464510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:17.474327 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:17.474927 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:17.476415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:17.485804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:17.486543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-d1396aa1-f320-45d9-adde-9b3a00351e05 req-1547ea2e-2a8a-405f-b22c-6fe83497408d service nova] Creating event network-vif-plugged:6f854937-824a-480d-a6f0-47591ff1371b for instance a8396993-2f10-4ec4-9745-8bbd605eeb9f on hv-cinder-85501 Sep 23 15:20:17.490648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:17.491461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:17.504212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-d1396aa1-f320-45d9-adde-9b3a00351e05 req-1547ea2e-2a8a-405f-b22c-6fe83497408d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089995 Sep 23 15:20:17.504846 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 146/326] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:17.748453 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:17.749709 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:17.764916 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:17.765727 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:17.766737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:17.767732 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:17.768681 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:17.769411 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:18.010964 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:18.022743 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f0e44005-7ca7-437b-a55b-5366130cb553 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.281292 Sep 23 15:20:18.023703 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 147/327] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:17 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:18.281233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:18.291280 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5d170456-82b2-4fd0-9c95-c333cfc1cf35 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.836873 Sep 23 15:20:18.292504 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 181/328] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:17 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:19.047441 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:19.048299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:19.066660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:19.067215 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:19.067652 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:19.068401 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:19.068881 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:19.070464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:19.315769 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:19.316389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:19.323806 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:19.324295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:19.324760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:19.334042 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:19.334540 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:19.334979 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:19.360508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:19.376045 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-93aa46da-06f7-4580-a459-52398c8771c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.332026 Sep 23 15:20:19.377511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 148/329] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:19 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:19.618022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:19.629800 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-384dd5b0-09da-4fd2-85ea-8d1b1012c15f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1314 microversion: 2.1 time: 0.318227 Sep 23 15:20:19.634079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 182/330] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:19 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:20.403731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:20.404347 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:20.426928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:20.427635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:20.428237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:20.429153 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:20.429758 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:20.430332 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:20.657416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:20.657968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:20.670135 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:20.670638 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:20.671093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:20.671829 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:20.672290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:20.672998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:20.943547 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:20.955797 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6971dcb6-6738-4bde-a43f-79c75ec79048 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1497 microversion: 2.1 time: 0.303147 Sep 23 15:20:20.956612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 183/331] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:20 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1497 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:20.960014 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:20.981201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9ed5a47d-b023-40ae-93b1-2a972201cba0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.584432 Sep 23 15:20:20.998373 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 149/332] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:20 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:21.773107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:21.773658 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:21.780356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:21.780894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:21.781530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:21.782669 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:21.783444 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:21.784095 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:21.789185 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:21.814850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:20:22.010860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:22.011455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:22.020700 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:22.021200 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:22.021628 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:22.022332 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:22.022782 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:22.023202 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:22.085885 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-07719bd0-0efd-4c48-a202-6c06508ca82f tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 204 len: 0 microversion: 2.1 time: 0.316493 Sep 23 15:20:22.087278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 184/333] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:20:21 2022] DELETE /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:20:22.099152 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:22.100733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:22.116269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:22.119401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:22.120503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:22.122001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:22.123412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:22.124349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:22.423013 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:22.439181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1c71286f-ad23-404d-a414-4ef51c13128e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1503 microversion: 2.1 time: 0.346569 Sep 23 15:20:22.439754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 185/334] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:22 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:22.492561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:22.506282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-98a19f35-0d4f-4376-a9cf-f40d3032ef36 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.496619 Sep 23 15:20:22.521134 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 150/335] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:22 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:23.298708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cdf55f56-a1ed-4419-b2a0-b4ac2ca4a978 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Action: 'create', calling method: .version_select at 0x7fbb03106700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1358845633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy/c0jCSWsDxoiDw1ir/DXP3tyckldqVUXbIWcH80oBcn/+6ksxXrRtuIAW67UhRIaVNsk5gC3BHfcznNmYzyWXFxV57sk3szkG+8nlNwxCPTTbdgIkJ9FXp1It1AFMUA=="}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:23.320402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-cdf55f56-a1ed-4419-b2a0-b4ac2ca4a978 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Getting quotas for project 592a763d7123405fb0576b00edfcd1bf. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:23.328565 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-cdf55f56-a1ed-4419-b2a0-b4ac2ca4a978 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Getting quotas for user 3077d51be16e40d9bb70b984583c0f8a and project 592a763d7123405fb0576b00edfcd1bf. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:23.353953 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cdf55f56-a1ed-4419-b2a0-b4ac2ca4a978 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.339001 Sep 23 15:20:23.355175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 186/336] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:20:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:20:23.463116 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:23.463790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:23.475955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:23.476389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:23.476849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:23.478175 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:23.478790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:23.479638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:23.531068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:23.532146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:23.555653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:23.556196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:23.556668 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:23.557529 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:23.558205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:23.558642 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:23.679840 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:23.688259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-27183c4f-7160-4dae-9342-37757344dcfc tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1503 microversion: 2.1 time: 0.229065 Sep 23 15:20:23.688934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 151/337] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:23 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:23.829669 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:23.837666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0e3821d1-54f2-4a85-b4b3-194d5ce059ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.311471 Sep 23 15:20:23.838243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 187/338] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:23 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:24.726654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:24.728105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:24.744901 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:24.746162 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:24.747264 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:24.749539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:24.750610 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:24.751447 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:24.861149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:24.862358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:24.873915 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:24.874775 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:24.876857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:24.877472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:24.878387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:24.881682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:24.882295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:24.889478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-223d5ef1-c4a2-42ca-8781-5727e07fa46b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1461 microversion: 2.1 time: 0.181952 Sep 23 15:20:24.890482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 152/339] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:24 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1461 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:25.243369 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-74dd343d-8562-4e90-bbeb-2a9cc6521f09 req-729ebe7d-6861-4ed6-ac53-a63a61bfd5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8396993-2f10-4ec4-9745-8bbd605eeb9f", "name": "network-vif-deleted", "tag": "6f854937-824a-480d-a6f0-47591ff1371b"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:25.270882 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-74dd343d-8562-4e90-bbeb-2a9cc6521f09 req-729ebe7d-6861-4ed6-ac53-a63a61bfd5ef service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:25.271704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-74dd343d-8562-4e90-bbeb-2a9cc6521f09 req-729ebe7d-6861-4ed6-ac53-a63a61bfd5ef service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:25.272259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-74dd343d-8562-4e90-bbeb-2a9cc6521f09 req-729ebe7d-6861-4ed6-ac53-a63a61bfd5ef service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:25.289799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-74dd343d-8562-4e90-bbeb-2a9cc6521f09 req-729ebe7d-6861-4ed6-ac53-a63a61bfd5ef service nova] Creating event network-vif-deleted:6f854937-824a-480d-a6f0-47591ff1371b for instance a8396993-2f10-4ec4-9745-8bbd605eeb9f on hv-cinder-85501 Sep 23 15:20:25.296969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-74dd343d-8562-4e90-bbeb-2a9cc6521f09 req-729ebe7d-6861-4ed6-ac53-a63a61bfd5ef service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059846 Sep 23 15:20:25.298409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 153/340] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:20:25.348012 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:25.356174 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-55f2f240-f574-48b0-9e6a-202a9a31abd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.499200 Sep 23 15:20:25.356792 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 188/341] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:24 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:25.924131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:25.924131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:25.924131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:25.924131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:25.924842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:25.924842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:25.924842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:25.925058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:25.965250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:25.966274 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:25.966897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:25.967507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lazy-loading 'fault' on Instance uuid a8396993-2f10-4ec4-9745-8bbd605eeb9f {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:20:26.022084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:26.030161 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fc794b46-35c9-49da-9ecf-2cb2cd130084 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1304 microversion: 2.1 time: 0.121307 Sep 23 15:20:26.030733 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 154/342] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:25 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:26.382768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:26.383369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:26.392010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:26.392999 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:26.393720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:26.394604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:26.395212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:26.395826 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:26.682585 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:26.690623 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ee50c6b0-be5a-4751-b3e3-f00c7db23ae2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.312313 Sep 23 15:20:26.691234 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 189/343] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:26 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:27.054198 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:27.054811 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:27.057388 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:27.062937 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.063336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.063770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.064464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.065005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.065522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.099025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.099504 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.099945 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.100384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lazy-loading 'fault' on Instance uuid a8396993-2f10-4ec4-9745-8bbd605eeb9f {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:20:27.141031 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:27.149417 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-76cb654f-77c7-4f26-87b0-711b95f5413c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1304 microversion: 2.1 time: 0.099329 Sep 23 15:20:27.149991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 155/344] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:27 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:27.717412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:27.718882 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:27.726575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.727147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.727783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.728687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:27.729330 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:27.730530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:27.901175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:27.910560 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f6ace75a-d452-4339-ba81-703fd734b7f2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.200544 Sep 23 15:20:27.911857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 190/345] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:27 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:28.174701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:28.176205 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:28.184445 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.185148 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.185592 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.186503 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.186971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.187401 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.198093 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:28.234422 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.235446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.236101 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.237097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lazy-loading 'fault' on Instance uuid a8396993-2f10-4ec4-9745-8bbd605eeb9f {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:20:28.295830 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:28.303768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ec820e95-1041-45e2-a181-85df46f6e50b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 200 len: 1304 microversion: 2.1 time: 0.133373 Sep 23 15:20:28.304861 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 156/346] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:28 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:28.935989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:28.936844 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:28.938789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:28.951460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.951973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.952411 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:28.953190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:28.953648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:28.954069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.112438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:29.120915 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-25939b88-ee04-427c-891d-0cfc647b7c2c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.188646 Sep 23 15:20:29.121555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 191/347] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:28 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:29.333190 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:29.333785 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: a8396993-2f10-4ec4-9745-8bbd605eeb9f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:29.340754 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:29.341259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:29.341649 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.342371 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:29.342827 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:29.343251 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.356730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] HTTP exception thrown: Instance a8396993-2f10-4ec4-9745-8bbd605eeb9f could not be found. Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Request method failure captured: Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f HTTP/1.1 Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc6bwzHADrWBZcvf0UnHfsFIFPAyQhT5oQTzINR5lJxdCKYK7hZ6oH8hF6Um3KDLXEKtQOzVFkPchu0kdENF3ffW29oJ9AB9tlDW9YY704KXvtfJ3DMa5V0xbF19403S9TTsgto6TRIZEgeMSV1y_9e7JY6My9vXSy03QinWUfsaAm8 Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: efa8ccdc30dc4651b730950a0a5fe8d4 Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-VolumesActionsTest-52899351 Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:20:29.358389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/efa8ccdc30dc4651b730950a0a5fe8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_efa8ccdc30dc4651b730950a0a5fe8d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/efa8ccdc30dc4651b730950a0a5fe8d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/efa8ccdc30dc4651b730950a0a5fe8d4"}]}] Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-VolumesActionsTest-52899351 Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: efa8ccdc30dc4651b730950a0a5fe8d4 Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-VolumesActionsTest-52899351 Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-VolumesActionsTest-52899351-project Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 159528b6ad49481f86bfbbac6187d584 Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-VolumesActionsTest-52899351-project Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance a8396993-2f10-4ec4-9745-8bbd605eeb9f could not be found. Sep 23 15:20:29.359774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'a8396993-2f10-4ec4-9745-8bbd605eeb9f'} Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8396993-2f10-4ec4-9745-8bbd605eeb9f could not be found. Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:20:29.360539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8396993-2f10-4ec4-9745-8bbd605eeb9f could not be found. Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8396993-2f10-4ec4-9745-8bbd605eeb9f could not be found. Sep 23 15:20:29.361878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:20:29.363130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Returning 404 to user: Instance a8396993-2f10-4ec4-9745-8bbd605eeb9f could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:20:29.363130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bf3e3f57-7ccc-46a0-8dd5-98b07f35f0fa tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f" status: 404 len: 111 microversion: 2.1 time: 0.031264 Sep 23 15:20:29.363130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 157/348] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:29 2022] GET /compute/v2.1/servers/a8396993-2f10-4ec4-9745-8bbd605eeb9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:20:29.474508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-50778410", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "networks": [{"uuid": "c67c26da-b776-4386-b438-d1ea6d9daf36"}]}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:29.529233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] validate_networks() for [('c67c26da-b776-4386-b438-d1ea6d9daf36', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:20:29.891257 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:20:29.891704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:20:29.892200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:20:29.892616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:20:29.893031 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:20:29.907035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:29.907519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:29.907956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.908789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:29.909243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:29.909672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:29.926618 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Getting quotas for project efa8ccdc30dc4651b730950a0a5fe8d4. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:20:29.930930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Getting quotas for user 159528b6ad49481f86bfbbac6187d584 and project efa8ccdc30dc4651b730950a0a5fe8d4. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:20:29.941910 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:20:29.944232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:20:29.996773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cfb519f8-7031-42b3-bfd1-a1fb14c3c991 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526440 Sep 23 15:20:29.997400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 192/349] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:20:30.010448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-87806e3a-b343-4eb1-938d-b531157af81e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:30.011060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-87806e3a-b343-4eb1-938d-b531157af81e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:30.063908 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-87806e3a-b343-4eb1-938d-b531157af81e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:30.071207 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-87806e3a-b343-4eb1-938d-b531157af81e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1212 microversion: 2.1 time: 0.066148 Sep 23 15:20:30.071781 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 158/350] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:30 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1212 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:30.143449 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:30.144159 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:30.151192 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:30.151676 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:30.152108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:30.152834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:30.153288 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:30.153973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:30.312015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:30.320530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c2d5aede-4d2e-4999-90ac-0146c91bb9ad tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.181123 Sep 23 15:20:30.321113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 193/351] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:30 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:31.094498 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:31.095813 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:31.104146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.104623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.105116 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.105808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.106257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.106677 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.178923 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:31.187082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-918695a5-540a-4be2-a88b-96c9a78f3b06 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.096436 Sep 23 15:20:31.187570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 159/352] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:31 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:31.345116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:31.346093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:31.352802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.353293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.353979 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.355188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:31.355982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:31.356759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:31.500916 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:31.509640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0426e0b0-158b-4a3c-b90d-b8154970516f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.170161 Sep 23 15:20:31.510233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 194/353] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:31 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:32.213297 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:32.214751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:32.223745 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.224464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.225062 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.225893 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.226425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.226928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.294093 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:32.302435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c8a1e8ca-4597-4c21-bc1f-d5771db21a4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.094048 Sep 23 15:20:32.303249 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 160/354] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:32 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:32.534861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:32.535589 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:32.542185 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.542674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.543104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.543988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:32.544445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:32.544892 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:32.699042 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:32.708438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-03a5c6cf-e12d-4f5b-895a-a337184ca7b6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.178820 Sep 23 15:20:32.709298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 195/355] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:32 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:33.325457 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:33.326058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:33.333232 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:33.334068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:33.334587 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:33.336321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:33.336842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:33.337307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:33.401051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:33.410233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a4b7ebd8-4060-4ec3-bad6-4cbea1f8b65e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.088711 Sep 23 15:20:33.410809 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 161/356] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:33 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:33.738700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:33.739730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:33.746320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:33.746798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:33.747223 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:33.747918 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:33.748398 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:33.748847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:33.889880 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:33.898926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-347a767b-cc18-476c-8260-6bbbf25c6c1c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.164205 Sep 23 15:20:33.899495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 196/357] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:33 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:34.434665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:34.435275 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:34.441965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:34.442453 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:34.442883 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:34.443891 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:34.445104 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:34.445533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:34.512186 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:34.520311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-250ed081-211b-445a-82f6-b43a9e27d1c3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.089916 Sep 23 15:20:34.520951 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 162/358] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:34 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:34.925279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:34.925901 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:34.933472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:34.934003 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:34.934480 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:34.935243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:34.935749 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:34.936248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.076259 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:35.083966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f5f6556a-5197-44ec-bb7c-ccf17188aed0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.163963 Sep 23 15:20:35.084773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 197/359] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:34 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:35.545324 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:35.545908 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:35.552851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.553335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.553764 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.554465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:35.554928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:35.555418 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:35.627167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:35.638367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4eeda152-d3b5-430c-8cd0-0e18aec79d91 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.097960 Sep 23 15:20:35.638930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 163/360] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:35 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:36.111475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:36.112099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:36.118697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.119214 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.119655 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.120372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.121022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.121347 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.256923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:36.265445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-56c8029b-6fdb-433e-9163-e1503e51a5df tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.162406 Sep 23 15:20:36.266006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 198/361] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:36 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:36.670746 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:36.671327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:36.678225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.678708 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.679145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.679837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:36.680288 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:36.680755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:36.743775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:36.752057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c051f4aa-41c1-4e95-afa0-d592e00178dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.085618 Sep 23 15:20:36.752624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 164/362] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:36 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:37.291976 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:37.292669 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:37.299961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.300457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.300931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.301635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.302112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.302533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.439398 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:37.447372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-65f2f539-9d47-422b-b855-49abc3c527a3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.161013 Sep 23 15:20:37.447959 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 199/363] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:37 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:37.779433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:37.780256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:37.790236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.790928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.791582 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.792534 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:37.793231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:37.793812 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:37.865985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:37.874682 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c52e5c76-b27d-45a2-a10d-0be1a612975e tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.101016 Sep 23 15:20:37.875259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 165/364] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:37 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:38.471249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:38.471827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:38.478378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:38.478864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.479297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.479993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:38.480455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.480907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.618590 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:38.622282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:38.627339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-23534a4d-8a20-4c76-be07-28fb8b6298a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.160335 Sep 23 15:20:38.627939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 200/365] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:38 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:38.898638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:38.899225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:38.906154 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:38.906726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.907179 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.907903 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:38.908357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:38.908800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:38.973360 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:38.981467 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-953d0a63-22f3-48bf-8a0d-6ba8a02f6a85 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.086731 Sep 23 15:20:38.982049 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 166/366] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:38 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:39.653720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:39.654726 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:39.663017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:39.663507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:39.663924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:39.664663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:39.665112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:39.665532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:39.795110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:39.803495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0032d179-2c36-4ff2-ae9a-0c2775544890 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.156317 Sep 23 15:20:39.804060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 201/367] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:39 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:40.005017 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:40.005631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:40.012312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.012849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.013284 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:40.013984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.014421 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.014911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:40.068334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:40.079586 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:40.087452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-51c4aec9-3795-4399-82b4-883cd3a6df4c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.086520 Sep 23 15:20:40.088007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 167/368] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:39 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:40.826968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:40.827564 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:40.829490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:40.830147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=10 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:40.835676 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.836144 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.836568 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:40.837277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:40.837725 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:40.838139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:40.981630 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:40.994183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-763782e6-eb3b-4970-94da-523dd590a4d7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.170838 Sep 23 15:20:40.994763 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 202/369] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:40 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:41.110229 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:41.110848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:41.118950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:41.119437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:41.119870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.120573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:41.121063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:41.121488 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:41.184913 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:41.196684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c67c9e46-8e95-43fb-8e6f-218fd2db3366 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.090171 Sep 23 15:20:41.197397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 168/370] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:41 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:42.023182 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:42.023761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:42.030181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.030671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.031101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.031801 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.032256 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.032720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.164921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:42.173119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d1671a9f-2ae8-4a0c-9807-e52f5e8c792e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.155124 Sep 23 15:20:42.173687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 203/371] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:42 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:42.220841 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:42.221492 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:42.230392 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.231137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.231570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.232566 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:42.233459 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:42.233949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:42.299846 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:42.311147 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-893c70cd-ee50-4198-bc05-c3d206493bad tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.095095 Sep 23 15:20:42.311851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 169/372] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:42 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:43.196554 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:43.197844 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:43.204334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.204862 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.205299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.206007 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.206460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.206883 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.337671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:43.338269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:43.344748 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.345294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.345724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.346426 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:43.346807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:43.346979 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:43.347277 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:43.355040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a458cc4d-a55b-4788-88ab-6b08c8b74657 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.162931 Sep 23 15:20:43.355604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 204/373] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:43 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:43.411401 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:43.420136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2b701647-0c2e-48d9-a135-081302b60e05 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.086340 Sep 23 15:20:43.420806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 170/374] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:43 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:44.383180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:44.384179 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:44.394421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:44.395236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:44.395946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:44.397268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:44.397729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:44.398154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:44.443348 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:44.444372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:44.451287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:44.451766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:44.452195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:44.452918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:44.453367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:44.453848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:44.517884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:44.526196 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c4eed643-716f-4567-bb3b-72f5fa421239 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.086743 Sep 23 15:20:44.526766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 171/375] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:44 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:44.530325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:44.538879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cb592aac-20aa-4402-b755-d0e26dc14c71 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.163093 Sep 23 15:20:44.539450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 205/376] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:44 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:45.551575 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:45.552272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:45.560187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.560699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.561128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.561828 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.562092 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:45.562551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.562674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.562752 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:45.569710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.570200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.570631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.571325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:45.571774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:45.572195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:45.714850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:45.723246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c16f6f64-b2ae-4dbe-9d4b-172b41549185 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.164912 Sep 23 15:20:45.723809 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 206/377] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:45 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:45.853351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:45.864127 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ab15f6fa-f9ca-4d18-9dc5-e825ad6c2689 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.317394 Sep 23 15:20:45.865087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 172/378] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:45 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:46.750551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:46.751534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:46.759986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.760470 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.760931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.761618 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.762062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.762477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.889335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:46.889950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:46.896194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.896722 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.897366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.898052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:46.898518 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:46.898941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:46.915253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:46.923745 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b3d46bde-083e-423f-b2ae-8db48fbc5a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.179497 Sep 23 15:20:46.924330 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 207/379] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:46 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:46.963752 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:46.971303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-adbd036a-2bad-4291-8e91-4b20cbebbf5b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1216 microversion: 2.1 time: 0.086118 Sep 23 15:20:46.971864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 173/380] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:46 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:47.949339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:47.950136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:47.957822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:47.958425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:47.959040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.959977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:47.960447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:47.960963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:47.995363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:47.996062 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:48.002682 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.003254 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.003766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.004616 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:48.005149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:48.005671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:48.011708 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:48.087738 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:48.096491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-203628c1-5377-478f-87a0-2292f14868e7 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1264 microversion: 2.1 time: 0.105462 Sep 23 15:20:48.097187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 174/381] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:47 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1264 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:48.112681 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:48.137040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6e53d167-f9c9-42bc-8799-d0a24f9e4bf0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1520 microversion: 2.1 time: 0.191290 Sep 23 15:20:48.137632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 208/382] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:47 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:49.121945 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:49.122555 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:49.129644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.130180 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.130620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.131321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.131774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.132461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.161053 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:49.161666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:49.179273 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.179769 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.180199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.180938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.181391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.181804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.206167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.217931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8621e454-976d-48dd-b390-0537f0d0dff3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1270 microversion: 2.1 time: 0.099792 Sep 23 15:20:49.218769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 175/383] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:49 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:49.409390 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.418452 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-81abd12a-a59f-486b-b43a-96c72d273020 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1500 microversion: 2.1 time: 0.261665 Sep 23 15:20:49.419151 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 209/384] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:49 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1500 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:20:49.442045 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:49.442692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:49.450861 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.451350 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.451786 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.452684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:49.453137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:49.453559 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:49.591954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:49.599889 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bec1d5ca-bb40-4743-95bd-b829bf1f748e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1516 microversion: 2.1 time: 0.162005 Sep 23 15:20:49.600437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 176/385] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:49 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:50.166951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-914069f6-b1fc-4393-b680-f1b8eeaca407 req-dc10134b-1719-45a8-8804-ff6c23a27838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ab3009-9f03-409b-9344-775b1b2aaf2e", "tag": "ae3504a9-1580-4b79-888e-eb91051d1fea"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:20:50.180206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-914069f6-b1fc-4393-b680-f1b8eeaca407 req-dc10134b-1719-45a8-8804-ff6c23a27838 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.180706 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-914069f6-b1fc-4393-b680-f1b8eeaca407 req-dc10134b-1719-45a8-8804-ff6c23a27838 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.181131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-914069f6-b1fc-4393-b680-f1b8eeaca407 req-dc10134b-1719-45a8-8804-ff6c23a27838 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.197205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-914069f6-b1fc-4393-b680-f1b8eeaca407 req-dc10134b-1719-45a8-8804-ff6c23a27838 service nova] Creating event network-changed:ae3504a9-1580-4b79-888e-eb91051d1fea for instance 18ab3009-9f03-409b-9344-775b1b2aaf2e on hv-cinder-85501 Sep 23 15:20:50.203108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-914069f6-b1fc-4393-b680-f1b8eeaca407 req-dc10134b-1719-45a8-8804-ff6c23a27838 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040680 Sep 23 15:20:50.204635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 210/386] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:20:50.246105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:50.246838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:50.253753 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.254235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.254665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.255357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:50.255975 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:50.256397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:50.417852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:50.426087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9c094f25-490b-45bb-8804-9488740129e0 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.184312 Sep 23 15:20:50.426643 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 177/387] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:50 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:51.450145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:51.450839 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:51.456962 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:51.457437 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:51.458049 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:51.458739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:51.459369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:51.459798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:51.640925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:51.648993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0d5fa0c8-bf8c-4619-b86d-82c81e6326de tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.203195 Sep 23 15:20:51.649562 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 211/388] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:51 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:52.671837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:52.672540 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:52.679086 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:52.679624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:52.680206 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.680767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:52.681197 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:52.681612 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:52.816799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:52.825241 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d94ccc88-ece9-4ef3-baab-94391a9ae937 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.157314 Sep 23 15:20:52.825818 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 178/389] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:52 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:53.853181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:53.854266 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:53.865194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.865938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.866794 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:53.867704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:53.867999 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:53.868417 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:54.002740 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:54.015127 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-017718d3-cd54-4c43-a281-2f37e4e19ddf tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.169135 Sep 23 15:20:54.015997 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 212/390] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:53 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:55.043163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:55.043943 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:55.053084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:55.053746 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:55.054349 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.055583 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:55.056225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:55.056871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:55.201748 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:55.209576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-80a97436-dabb-4a48-9890-4491b3a7bf66 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.171914 Sep 23 15:20:55.210183 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 179/391] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:55 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:56.236940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:56.238222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:56.246874 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.247353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.247831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:56.248466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:56.248935 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:56.249385 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:56.383014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:56.391360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-86a52dbb-7641-4d61-aa88-23feb47b5843 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.161181 Sep 23 15:20:56.391926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 213/392] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:56 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:57.414831 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:57.415510 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:57.417886 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=56 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:20:57.422985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:57.423473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:57.423907 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.424630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:57.425094 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:57.425515 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:57.561222 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:57.569397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-27298af2-9b73-4337-80d1-7ac637422e48 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.158609 Sep 23 15:20:57.569964 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 180/393] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:57 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:58.596084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:58.597015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:58.606296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.607129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.607758 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.608840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:58.609494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:58.610107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:58.744740 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:58.752978 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c5fdbd81-1036-4335-a399-c77080194a53 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.162585 Sep 23 15:20:58.753526 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 214/394] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:58 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:20:59.775655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:20:59.776328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:20:59.783551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:59.784105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:59.784618 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:59.785339 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:20:59.785788 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:20:59.786207 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:20:59.924830 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:20:59.934048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d24a2dae-c4fe-457b-87a6-065fb26adc39 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.162535 Sep 23 15:20:59.934626 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 181/395] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:20:59 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:00.959225 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:00.960065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:00.962708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:00.969555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.970223 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.972519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:00.972519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:00.972519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:00.972948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.109171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:01.117864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-07630ee8-cb01-4c49-adae-8f0b1a371050 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.164245 Sep 23 15:21:01.118472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 215/396] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:00 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:01.664629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:01.667040 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:01.673929 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.674418 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.674857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.675557 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.676006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.676432 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.700773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'flavor' on Instance uuid c685e650-6379-4809-8cec-3549d4a26ab1 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:01.777584 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-0bf70f43-5598-4dea-a881-134e689a6bf6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1/action" status: 200 len: 32 microversion: 2.1 time: 0.116953 Sep 23 15:21:01.778190 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 182/397] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:21:01 2022] POST /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:21:01.787902 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:01.788559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:01.795290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.795789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.796221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.796958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:01.797432 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:01.797855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:01.933356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:01.941257 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-622c235a-25f0-43fc-9840-31105d0f5f8b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.157267 Sep 23 15:21:01.941831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 216/398] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:01 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:02.146597 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:02.147640 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:02.155676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.156162 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.156617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.157336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.157792 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.158219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.301449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:02.309830 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-03dc90fd-c9b0-46d0-99fc-14f1e3f0c73d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.170443 Sep 23 15:21:02.310398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 183/399] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:02 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:02.965313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:02.966015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:02.973396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.973890 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.974352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:02.975048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:02.975510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:02.975930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.109636 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:03.117952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1d254af3-f297-40e4-85c1-1393c04a50a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.156924 Sep 23 15:21:03.118530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 217/400] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:02 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:03.336830 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:03.337824 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:03.350866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.351492 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.352394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.354635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:03.355129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:03.355551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:03.495719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:03.503850 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8e78bc3f-781f-4a1c-accf-53a092d0b096 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.173518 Sep 23 15:21:03.504491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 184/401] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:03 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:04.145958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:04.146990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:04.157392 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:04.158211 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:04.158941 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:04.160103 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:04.160925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:04.161639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:04.167824 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:04.299920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:04.308128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-35e2b8c7-62ae-4b53-bf15-79a89fd84df5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.168616 Sep 23 15:21:04.308692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 218/402] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:04 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:04.530304 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:04.531030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:04.539366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:04.539964 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:04.540499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:04.542135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:04.542713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:04.543245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:04.686836 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:04.695056 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9472ba9c-9ba9-47eb-a842-0460fcf529a3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.170852 Sep 23 15:21:04.695646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 185/403] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:04 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:05.331085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:05.331751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:05.339025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.339719 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.340165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.340940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.341390 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.341817 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.550302 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:05.558820 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5a45aad9-e67c-4241-a46a-21472bd3f01b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.231606 Sep 23 15:21:05.559429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 219/404] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:05 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:05.721195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:05.722048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:05.731035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.731517 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.731950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.732695 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:05.733153 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:05.733579 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:05.877042 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:05.884986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c3d0f664-57f3-4935-a206-6933f0d90cca tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.169653 Sep 23 15:21:05.885520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 186/405] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:05 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:06.582139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:06.582743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:06.588924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:06.589476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:06.590105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:06.590832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:06.591257 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:06.591683 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:06.727997 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:06.736485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bf40631b-36a7-451b-a7e6-f3cbdf02a4a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.158278 Sep 23 15:21:06.737082 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 220/406] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:06 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:06.908825 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:06.909446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:06.916395 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:06.917371 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:06.918028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:06.918730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:06.919178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:06.919600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.054100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:07.063120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c5a33cfc-cac4-476d-b30e-ba43e9ab1172 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.159052 Sep 23 15:21:07.063773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 187/407] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:06 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:07.300087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-357092089", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1358845633", "security_groups": [{"name": "tempest-secgroup-smoke-474576661"}], "networks": [{"uuid": "5eb08fcc-94bd-488a-98f7-4db4f5e03842"}], "block_device_mapping_v2": [{"uuid": "3e266273-44c2-4ba4-a921-fbfeebc4a902", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:07.425394 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] validate_networks() for [('5eb08fcc-94bd-488a-98f7-4db4f5e03842', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:21:07.650338 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-43084817-9de7-4113-9ad2-94460c088670 req-fb043cab-1f05-4309-bcd7-65a59dc53010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ab3009-9f03-409b-9344-775b1b2aaf2e", "name": "network-vif-plugged", "status": "completed", "tag": "ae3504a9-1580-4b79-888e-eb91051d1fea"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:07.661697 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-43084817-9de7-4113-9ad2-94460c088670 req-fb043cab-1f05-4309-bcd7-65a59dc53010 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.662420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-43084817-9de7-4113-9ad2-94460c088670 req-fb043cab-1f05-4309-bcd7-65a59dc53010 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.662852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-43084817-9de7-4113-9ad2-94460c088670 req-fb043cab-1f05-4309-bcd7-65a59dc53010 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.675201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-43084817-9de7-4113-9ad2-94460c088670 req-fb043cab-1f05-4309-bcd7-65a59dc53010 service nova] Creating event network-vif-plugged:ae3504a9-1580-4b79-888e-eb91051d1fea for instance 18ab3009-9f03-409b-9344-775b1b2aaf2e on hv-cinder-85501 Sep 23 15:21:07.679958 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-43084817-9de7-4113-9ad2-94460c088670 req-fb043cab-1f05-4309-bcd7-65a59dc53010 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034844 Sep 23 15:21:07.680753 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 188/408] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:21:07.760221 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:07.764998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:07.781080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.782460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.783121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.784545 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.785100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.785602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.810712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:07.913344 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:21:07.913893 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:21:07.914436 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:21:07.914871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:21:07.915284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:21:07.937573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.938108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.938542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.939269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:07.939718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:07.940549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:07.950366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:07.960717 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-53a00d94-649c-41cc-afad-345b091722c0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.203364 Sep 23 15:21:07.961895 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 189/409] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:07 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:07.962421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Getting quotas for project 592a763d7123405fb0576b00edfcd1bf. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:21:07.966883 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Getting quotas for user 3077d51be16e40d9bb70b984583c0f8a and project 592a763d7123405fb0576b00edfcd1bf. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:21:08.027183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:21:08.029585 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e266273-44c2-4ba4-a921-fbfeebc4a902',volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:21:08.087447 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:08.088426 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:08.095698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:08.096208 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:08.096671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:08.097532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:08.098281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:08.098822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:08.210828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6c7eb73e-8d61-45da-83da-e2e426d16250 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.914544 Sep 23 15:21:08.211776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 221/410] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:21:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:21:08.223031 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6506b48a-81ff-4a91-b21e-4eb8fd536f12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:08.223840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6506b48a-81ff-4a91-b21e-4eb8fd536f12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:08.329635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6506b48a-81ff-4a91-b21e-4eb8fd536f12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:08.337025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6506b48a-81ff-4a91-b21e-4eb8fd536f12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1088 microversion: 2.1 time: 0.117717 Sep 23 15:21:08.337876 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 222/411] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:08 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1088 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:08.342634 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:08.350365 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2b277ba6-06cd-4708-badd-13da6d9d6f4b tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.267650 Sep 23 15:21:08.356661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 190/412] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:08 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:08.983571 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:08.984299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:08.990767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:08.991325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:08.991829 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:08.992687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:08.993218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:08.993699 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:09.365563 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:09.366288 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:09.384396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:09.386534 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:09.387028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:09.388962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:09.389616 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:09.390100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:09.412578 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:09.426643 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f94de37f-65c4-473f-9166-81be942bdd54 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.446308 Sep 23 15:21:09.427229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 223/413] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:08 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:09.445005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:09.451523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:09.458410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:09.459038 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:09.459340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:09.472379 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:09.472906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:09.473425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:09.527119 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:09.561311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4506f893-fa56-43b5-a43c-77cc2f906435 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1130 microversion: 2.1 time: 0.200527 Sep 23 15:21:09.561982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 191/414] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:09 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1130 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:09.706578 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:09.716565 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-186ce522-e131-4d21-8f9f-b3c1598f07ba tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1312 microversion: 2.1 time: 0.275229 Sep 23 15:21:09.717309 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 224/415] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:09 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:10.450177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:10.451328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:10.458532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:10.459023 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:10.459459 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:10.460243 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:10.460731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:10.461162 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:10.586385 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:10.587617 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:10.596731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:10.597365 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:10.597802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:10.598498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:10.598932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:10.599349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:10.625380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:10.634222 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-27f09e1e-d52c-4735-ab8e-d3c93098ea22 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.187998 Sep 23 15:21:10.634926 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 192/416] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:10 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:10.703255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:10.713443 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3e0c623e-2d8a-4871-9fb6-a46972c5f3ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1186 microversion: 2.1 time: 0.132010 Sep 23 15:21:10.714062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 225/417] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:10 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1186 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:10.739487 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:10.740449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:10.747828 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:10.748316 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:10.749015 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:10.749931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:10.750387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:10.750815 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:10.918359 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:10.934719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b273b8c3-9108-4e4d-a50d-d6e65cf5219a tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1496 microversion: 2.1 time: 0.198968 Sep 23 15:21:10.935516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 193/418] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:10 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1496 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:11.663173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:11.663883 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:11.670917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:11.671650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:11.672396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:11.673117 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:11.673740 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:11.674163 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:11.736234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:11.737496 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:11.745516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:11.746019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:11.746620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:11.748135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:11.748632 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:11.749071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:11.813037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:11.820391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:11.825353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-60590efd-d9fa-431e-abac-4c9a2d9a6f3a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.166273 Sep 23 15:21:11.827112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 226/419] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:11 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:11.828892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5df04061-97f3-4b1f-b05f-8961e6ad7f37 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1186 microversion: 2.1 time: 0.097050 Sep 23 15:21:11.829454 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 194/420] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:11 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:12.849759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:12.851003 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:12.855462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:12.856138 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:12.857587 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:12.858058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:12.858692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:12.859737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:12.860206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:12.860655 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:12.863505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:12.865283 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:12.865893 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:12.866609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:12.867066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:12.867496 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:12.934263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:12.942468 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1d485c9e-5376-4e4a-98d1-55bc7db75e02 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1186 microversion: 2.1 time: 0.091324 Sep 23 15:21:12.943677 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 195/421] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:12 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:13.001930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:13.009983 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fc85c4bf-a004-4ff4-8998-a9d06a3e0180 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.164089 Sep 23 15:21:13.010576 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 227/422] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:12 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:13.968537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:13.969479 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:13.977873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:13.978624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:13.979172 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:13.980087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:13.980891 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:13.981618 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:14.036889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:14.038018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:14.044736 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:14.045493 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:14.046430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:14.047586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:14.048383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:14.049044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:14.055128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:14.063284 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5e826822-597a-4511-a46d-477aab91fe2a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1186 microversion: 2.1 time: 0.100150 Sep 23 15:21:14.064060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 196/423] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:13 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:14.189388 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:14.198102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-38fa075c-b648-4e03-9254-accb5dfd1199 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.165242 Sep 23 15:21:14.199078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 228/424] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:14 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:14.351896 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:14.352405 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:14.358586 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:14.359057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:14.359486 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:14.360180 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:14.360653 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:14.361074 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:14.388683 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:21:14.485484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c42dcd3e-d801-4d01-9d9c-8452216dc049 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "DELETE /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 204 len: 0 microversion: 2.1 time: 0.142845 Sep 23 15:21:14.486282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 197/425] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:21:14 2022] DELETE /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:21:14.496259 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:14.504835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:14.516653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:14.517354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:14.517946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:14.519024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:14.519785 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:14.520359 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:14.729489 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:14.737472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-642ca4fe-207e-4bc3-8f75-a8b1f0ace8e3 tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1502 microversion: 2.1 time: 0.246502 Sep 23 15:21:14.738238 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 229/426] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:14 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1502 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:15.086973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:15.087838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:15.096380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:15.096996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:15.097494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:15.098237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:15.098890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:15.099318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:15.168704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:15.177508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-41c36431-5567-498c-88e0-7efadebf3f67 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1204 microversion: 2.1 time: 0.095159 Sep 23 15:21:15.178069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 198/427] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:15 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:15.222197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:15.222944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:15.228963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:15.229636 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:15.230136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:15.230954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:15.231388 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:15.231823 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:15.367423 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:15.375962 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d6d36bcb-4c90-4117-896d-25e69fa506dd tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.157677 Sep 23 15:21:15.376598 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 230/428] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:15 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:15.761295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:15.762071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:15.768820 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:15.769404 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:15.769883 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:15.770737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:15.771248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:15.771749 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:15.940628 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:15.948690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c6a46cef-80d7-4175-ad4b-c1d54d0002dd tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1502 microversion: 2.1 time: 0.191579 Sep 23 15:21:15.951584 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 199/429] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:15 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:16.200990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:16.204756 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:16.219156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:16.221137 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:16.223103 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:16.224872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:16.227360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:16.227979 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:16.368140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:16.377707 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-93b0046a-7d26-409b-90a1-096eb22309b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1204 microversion: 2.1 time: 0.180760 Sep 23 15:21:16.394632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 231/430] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:16 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1204 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:16.399711 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:16.401048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:16.410801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:16.411551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:16.412199 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:16.413730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:16.414415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:16.415099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:16.595416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:16.603217 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-75106f13-9d87-4990-ad50-9f7bae087c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.207869 Sep 23 15:21:16.604090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 200/431] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:16 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:16.974737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:16.976476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:16.984645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:16.985415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:16.986249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:16.987187 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:16.987852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:16.988687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.214859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:17.224153 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-69969161-aabf-42e3-a140-e7e0107e880d tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1502 microversion: 2.1 time: 0.255136 Sep 23 15:21:17.225147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 232/432] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:16 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:17.410404 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:17.411581 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-53463383-d40a-4ab2-b886-3041b58ea094 req-f534bc0d-e015-4fbe-a570-4a7f0e125c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ab3009-9f03-409b-9344-775b1b2aaf2e", "name": "network-vif-deleted", "tag": "ae3504a9-1580-4b79-888e-eb91051d1fea"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:17.413664 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:17.433239 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:17.433902 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:17.434855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-53463383-d40a-4ab2-b886-3041b58ea094 req-f534bc0d-e015-4fbe-a570-4a7f0e125c35 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:17.435326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.435529 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-53463383-d40a-4ab2-b886-3041b58ea094 req-f534bc0d-e015-4fbe-a570-4a7f0e125c35 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:17.435967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-53463383-d40a-4ab2-b886-3041b58ea094 req-f534bc0d-e015-4fbe-a570-4a7f0e125c35 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.436697 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:17.437353 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:17.437966 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.452624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-53463383-d40a-4ab2-b886-3041b58ea094 req-f534bc0d-e015-4fbe-a570-4a7f0e125c35 service nova] Creating event network-vif-deleted:ae3504a9-1580-4b79-888e-eb91051d1fea for instance 18ab3009-9f03-409b-9344-775b1b2aaf2e on hv-cinder-85501 Sep 23 15:21:17.460679 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-53463383-d40a-4ab2-b886-3041b58ea094 req-f534bc0d-e015-4fbe-a570-4a7f0e125c35 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055908 Sep 23 15:21:17.465118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 233/433] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:21:17.618710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:17.627765 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2160d069-431f-43e8-bfa4-0503cdb55c83 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1271 microversion: 2.1 time: 0.230512 Sep 23 15:21:17.628622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 201/434] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:17 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:17.644791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:17.644791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:17.653408 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:17.653901 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:17.654336 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.656837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:17.657311 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:17.657748 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.731436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-b260f8dc-50d4-4688-86aa-5c789e848b87 req-4507de67-786a-456e-bd1d-16c8641ecb87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0a3e47-96a7-461b-81dc-e879cf1df317", "tag": "aa222fb4-42c6-4891-beb9-013184d89cc9"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:17.755897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-b260f8dc-50d4-4688-86aa-5c789e848b87 req-4507de67-786a-456e-bd1d-16c8641ecb87 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:17.760771 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-b260f8dc-50d4-4688-86aa-5c789e848b87 req-4507de67-786a-456e-bd1d-16c8641ecb87 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:17.763545 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-b260f8dc-50d4-4688-86aa-5c789e848b87 req-4507de67-786a-456e-bd1d-16c8641ecb87 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:17.792529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-b260f8dc-50d4-4688-86aa-5c789e848b87 req-4507de67-786a-456e-bd1d-16c8641ecb87 service nova] Creating event network-changed:aa222fb4-42c6-4891-beb9-013184d89cc9 for instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 on hv-cinder-85501 Sep 23 15:21:17.814145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-b260f8dc-50d4-4688-86aa-5c789e848b87 req-4507de67-786a-456e-bd1d-16c8641ecb87 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086878 Sep 23 15:21:17.815387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 202/435] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:21:17.951560 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:17.998017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:18.006592 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-45e3364f-c4d0-44fa-9b7e-4b3af6e2aa4e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.383001 Sep 23 15:21:18.007238 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 234/436] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:17 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:18.249957 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:18.250939 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:18.262965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:18.263685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:18.268697 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:18.269571 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:18.270044 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:18.270468 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:18.338603 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:18.339259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:18.340105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:18.341118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lazy-loading 'fault' on Instance uuid 18ab3009-9f03-409b-9344-775b1b2aaf2e {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:21:18.411436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159528b6ad49481f86bfbbac6187d584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa8ccdc30dc4651b730950a0a5fe8d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:18.426454 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7acad902-e68d-414f-9161-b1976f1ed9ab tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 200 len: 1302 microversion: 2.1 time: 0.180924 Sep 23 15:21:18.427351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 203/437] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:18 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 1302 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:18.663833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:18.668942 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:18.678933 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=8 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:18.682396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:18.683380 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:18.684151 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:18.690105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:18.690859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:18.691485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:18.859488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:18.868179 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-acb61a01-838a-4913-b472-07f1682141f0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.219577 Sep 23 15:21:18.868780 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 235/438] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:18 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:19.042487 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:19.042799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:19.048865 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:19.049322 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:19.049751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:19.050442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:19.050885 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:19.051311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:19.193039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:19.197308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:19.202485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cb62c28f-e96b-49bb-be44-54d0c8a8fb68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.164981 Sep 23 15:21:19.203059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 204/439] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:19 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:19.451810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:19.452412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] [instance: 18ab3009-9f03-409b-9344-775b1b2aaf2e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:19.458768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:19.459251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:19.459692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:19.460387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:19.460865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:19.461270 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:19.475344 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] HTTP exception thrown: Instance 18ab3009-9f03-409b-9344-775b1b2aaf2e could not be found. Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Request method failure captured: Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e HTTP/1.1 Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc6bwzHADrWBZcvf0UnHfsFIFPAyQhT5oQTzINR5lJxdCKYK7hZ6oH8hF6Um3KDLXEKtQOzVFkPchu0kdENF3ffW29oJ9AB9tlDW9YY704KXvtfJ3DMa5V0xbF19403S9TTsgto6TRIZEgeMSV1y_9e7JY6My9vXSy03QinWUfsaAm8 Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: efa8ccdc30dc4651b730950a0a5fe8d4 Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesActionsTest-52899351 Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:21:19.477018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/efa8ccdc30dc4651b730950a0a5fe8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_efa8ccdc30dc4651b730950a0a5fe8d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/efa8ccdc30dc4651b730950a0a5fe8d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/efa8ccdc30dc4651b730950a0a5fe8d4"}]}] Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesActionsTest-52899351 Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: efa8ccdc30dc4651b730950a0a5fe8d4 Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesActionsTest-52899351 Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesActionsTest-52899351-project Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 159528b6ad49481f86bfbbac6187d584 Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesActionsTest-52899351-project Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 18ab3009-9f03-409b-9344-775b1b2aaf2e could not be found. Sep 23 15:21:19.478583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '18ab3009-9f03-409b-9344-775b1b2aaf2e'} Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ab3009-9f03-409b-9344-775b1b2aaf2e could not be found. Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:21:19.479361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ab3009-9f03-409b-9344-775b1b2aaf2e could not be found. Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ab3009-9f03-409b-9344-775b1b2aaf2e could not be found. Sep 23 15:21:19.481060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:19.482130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] Returning 404 to user: Instance 18ab3009-9f03-409b-9344-775b1b2aaf2e could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:21:19.482130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-565f0a59-9158-42d5-99e6-1dba45871a0c tempest-VolumesActionsTest-52899351 tempest-VolumesActionsTest-52899351-project] 10.222.0.75 "GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e" status: 404 len: 111 microversion: 2.1 time: 0.030893 Sep 23 15:21:19.482130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 236/440] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:19 2022] GET /compute/v2.1/servers/18ab3009-9f03-409b-9344-775b1b2aaf2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:21:19.900922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:19.900922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:19.901560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:19.901560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:19.901938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:19.904246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:19.906375 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:19.908352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:20.080268 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:20.089234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8e8a2910-774b-4e94-913f-5cc20573c4eb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.200440 Sep 23 15:21:20.090098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 205/441] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:19 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:20.241933 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:20.242652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:20.254110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:20.254965 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:20.255507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:20.256602 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:20.257544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:20.268694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:20.557897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:20.561548 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:20.569046 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8c19a970-cc5a-4945-a75e-86053f666075 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.345231 Sep 23 15:21:20.569962 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 237/442] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:20 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:21.112106 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:21.112832 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:21.120106 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:21.120771 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:21.128925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:21.129935 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:21.130594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:21.131897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:21.289368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:21.298511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-df6706ca-2b1e-4683-93ff-ef6ddfb31ccf tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.190630 Sep 23 15:21:21.313640 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 206/443] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:21 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:21.598158 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:21.599373 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:21.606143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:21.606627 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:21.607336 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:21.608218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:21.608694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:21.609348 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:21.782358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:21.790285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-92057a13-6ece-4c0c-b801-cad1f072b98b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.197676 Sep 23 15:21:21.790857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 238/444] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:21 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:22.330265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:22.330856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:22.337660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:22.338140 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:22.338569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:22.339261 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:22.339843 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:22.340298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:22.476945 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:22.484766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5aef26b9-c1fe-43de-8f08-2ba063ebef6c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.158594 Sep 23 15:21:22.485343 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 207/445] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:22 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:22.814418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:22.815030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:22.821138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:22.825148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:22.825573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:22.826287 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:22.826749 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:22.827174 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:22.964619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:22.972460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-332c7c3b-85f2-4216-aa46-df14ca48f58e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.162324 Sep 23 15:21:22.973085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 239/446] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:22 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:23.508942 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:23.509745 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:23.516605 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:23.517243 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:23.517757 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:23.518527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:23.519070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:23.519616 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:23.674507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:23.683994 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-86e7a41d-e0ae-44c8-9fbc-ca192fbaf888 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.178772 Sep 23 15:21:23.689041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 208/447] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:23 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:23.996501 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:23.997829 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:24.004614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:24.005104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:24.005519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:24.006220 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:24.006663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:24.007077 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:24.138189 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:24.146651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-21e5942a-52e6-4dd2-834a-f5825c6df517 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.154614 Sep 23 15:21:24.147230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 240/448] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:23 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:24.706677 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:24.707462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:24.714235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:24.715027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:24.715460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:24.716157 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:24.716622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:24.717050 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:24.857774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:24.865993 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-21b8f32d-2151-4b99-bb17-bbde61bbe7cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.163231 Sep 23 15:21:24.866565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 209/449] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:24 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:25.170218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:25.170847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:25.177233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:25.177727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:25.178155 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:25.178843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:25.179288 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:25.179698 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:25.312228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:25.321351 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c9831ec7-8191-4c8c-a226-9a42bbf8b046 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.155208 Sep 23 15:21:25.321943 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 241/450] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:25 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:25.889074 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:25.889615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:25.895921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:25.896403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:25.897029 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:25.897721 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:25.898166 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:25.899150 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:26.043868 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:26.052314 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-80603232-a551-440f-9393-8b5a1b437fd2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.167475 Sep 23 15:21:26.052927 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 210/451] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:25 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:26.345783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:26.347370 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:26.354222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:26.355079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:26.355785 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:26.356808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:26.357484 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:26.358108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:26.509436 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:26.522665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5f8b7524-afa0-4558-bd36-4dc6ab0ca74d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.181041 Sep 23 15:21:26.524898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 242/452] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:26 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:27.078048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:27.079374 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:27.085910 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:27.086609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:27.087215 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:27.088238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:27.089002 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:27.089962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:27.300023 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:27.311367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f6d57b32-c8d2-4d8d-9772-599e17828c0d tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.237590 Sep 23 15:21:27.312520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 211/453] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:27 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:27.547767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:27.548837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:27.558592 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:27.559591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:27.560257 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:27.561560 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:27.562938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:27.563572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:27.849118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:27.864030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cd8ca2e4-7e55-4a2a-8564-9f928d0f27d8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.320083 Sep 23 15:21:27.864944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 243/454] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:27 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:28.338573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:28.339408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:28.341980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:28.353581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:28.355773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:28.356627 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:28.358530 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:28.359212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:28.359858 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:28.574710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:28.588784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-829b9f86-7e7f-4bfc-9a05-e54b06f1b0ae tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.257027 Sep 23 15:21:28.589925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 212/455] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:28 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:28.905170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:28.906571 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:28.913896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:28.914808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:28.915345 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:28.916333 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:28.917194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:28.917889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:29.141804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:29.150768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6440439e-21f5-4b2d-b61c-e293434bd399 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.249952 Sep 23 15:21:29.153977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 244/456] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:28 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:29.268937 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-96130054-8a92-4d27-8390-7872ea7c6d6e req-b1fe8e5d-9acf-4a3c-aed2-9f4c5ec4be36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0a3e47-96a7-461b-81dc-e879cf1df317", "name": "network-vif-plugged", "status": "completed", "tag": "aa222fb4-42c6-4891-beb9-013184d89cc9"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:29.279154 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-96130054-8a92-4d27-8390-7872ea7c6d6e req-b1fe8e5d-9acf-4a3c-aed2-9f4c5ec4be36 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:29.279902 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-96130054-8a92-4d27-8390-7872ea7c6d6e req-b1fe8e5d-9acf-4a3c-aed2-9f4c5ec4be36 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:29.280525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-96130054-8a92-4d27-8390-7872ea7c6d6e req-b1fe8e5d-9acf-4a3c-aed2-9f4c5ec4be36 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:29.293744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-96130054-8a92-4d27-8390-7872ea7c6d6e req-b1fe8e5d-9acf-4a3c-aed2-9f4c5ec4be36 service nova] Creating event network-vif-plugged:aa222fb4-42c6-4891-beb9-013184d89cc9 for instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 on hv-cinder-85501 Sep 23 15:21:29.298954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-96130054-8a92-4d27-8390-7872ea7c6d6e req-b1fe8e5d-9acf-4a3c-aed2-9f4c5ec4be36 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034909 Sep 23 15:21:29.299614 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 213/457] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:21:29.619966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:29.620825 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:29.631267 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:29.631759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:29.632201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:29.635332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:29.635807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:29.636317 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:29.834493 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:29.846468 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-afba8cfa-4ef5-41cf-8731-b00cf07f5eea tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.235175 Sep 23 15:21:29.847609 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 245/458] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:29 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:30.178293 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:30.179810 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:30.186956 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:30.187412 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:30.187867 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:30.188678 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:30.189138 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:30.189562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:30.342818 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:30.350794 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e14324ee-6a7c-4850-a150-74cc171a78bb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.177702 Sep 23 15:21:30.351378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 214/459] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:30 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:30.875070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:30.876723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:30.884669 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:30.885158 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:30.885595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:30.886293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:30.887022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:30.887982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:31.057350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:31.070318 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-30f627c9-3f9f-40df-bd13-c50455289e17 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.202095 Sep 23 15:21:31.085248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 246/460] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:30 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:31.373572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:31.374194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:31.380927 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:31.381526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:31.382174 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:31.382894 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:31.383341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:31.383783 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:31.597131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:31.605621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-56fea792-25b2-42cf-a6ee-9da4a4b49644 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.235890 Sep 23 15:21:31.606184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 215/461] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:31 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:32.097256 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:32.098070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:32.100228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:32.105924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.106694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.107472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:32.108386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.109075 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.109725 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:32.282324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:32.291449 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f592e233-d56e-478b-b2d2-afb0bd42b19b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.198321 Sep 23 15:21:32.292277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 247/462] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:32 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:32.636987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:32.636987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:32.640725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.641230 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.641653 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:32.642991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:32.644854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:32.645647 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:32.802773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:32.812458 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b0995155-0e6f-43f5-b8f1-acb6403f8f3e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.186500 Sep 23 15:21:32.813097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 216/463] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:32 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:33.317689 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:33.318335 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:33.326069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:33.326545 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:33.327166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:33.328021 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:33.328469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:33.328961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:33.484493 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:33.493443 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-27b18858-4c38-4e7d-b418-67b22d0534be tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.182172 Sep 23 15:21:33.494555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 248/464] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:33 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:33.838175 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:33.839001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:33.854683 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:33.855690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:33.856710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:33.857940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:33.858500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:33.858978 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:34.004986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:34.015258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dbd76a04-23d4-4c28-b985-0ed2baeadf2a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.182556 Sep 23 15:21:34.016045 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 217/465] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:33 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:34.517951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:34.518613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:34.525939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:34.526846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:34.527487 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:34.528659 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:34.529431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:34.529977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:34.674564 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:34.684404 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f28be81d-ce2e-488e-b89c-f92cea90ef12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.170050 Sep 23 15:21:34.697142 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 249/466] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:34 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:35.040978 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:35.042451 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:35.049976 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:35.050633 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:35.051184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:35.052007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:35.052576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:35.053145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:35.238486 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:35.249314 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-579fef95-45f4-4d7a-9765-07741a9be515 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.211251 Sep 23 15:21:35.250571 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 218/467] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:35 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:35.710181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:35.711014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:35.719737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:35.720221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:35.720692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:35.721588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:35.722131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:35.722602 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:35.884344 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:35.893067 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f6af5409-a42b-491d-89f7-8ba0f069676a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.187813 Sep 23 15:21:35.893640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 250/468] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:35 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:36.278311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:36.279174 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:36.287055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.287830 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.288490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.289768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.290485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.291342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.384744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:21:36.384990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Fri Sep 23 15:21:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 (ip 10.222.0.75) !!! Sep 23 15:21:36.471897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:36.487704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dc0db78c-32a7-48b1-9616-b434803933a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1502 microversion: 2.1 time: 0.213102 Sep 23 15:21:36.488982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 219/469] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:36 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:36.524848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2259c9f9-e06a-400a-bdb9-d486f9ba1f93"}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:36.527619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:36.534197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.534991 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.535652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.536580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.537599 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.538287 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.572246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] HTTP exception thrown: Cannot 'attach_volume' instance c685e650-6379-4809-8cec-3549d4a26ab1 while it is in vm_state rescued Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Request method failure captured: Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: POST /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1/os-volume_attachments HTTP/1.1 Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 74 Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4v9pxEJ1GpUW2lHlRNm3QpF5nvIevVMf9lP9v--RxSo7eSx4YJ-Deu_hBvtd-nl2xQdH0M6DPTGxOeQ1bepbh069Zba1lVXk6rl9ZJG1TZcCvKiBttYubPPwOANtZ3iLeWQ1YPshCdqdA3vVdRIIucD8Z-7bzSBbWjWZtTATOH78c Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:21:36.574503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1abe4f1508864f77b30c4c635c368f02"}]}] Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4cfac62e1c304167abb971815d5da358 Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {"volumeAttachment": {"volumeId": "2259c9f9-e06a-400a-bdb9-d486f9ba1f93"}} Sep 23 15:21:36.576386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Cannot 'attach_volume' instance c685e650-6379-4809-8cec-3549d4a26ab1 while it is in vm_state rescued Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'server_id': 'c685e650-6379-4809-8cec-3549d4a26ab1', 'body': {'volumeAttachment': {'volumeId': '2259c9f9-e06a-400a-bdb9-d486f9ba1f93'}}} Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c685e650-6379-4809-8cec-3549d4a26ab1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:21:36.577217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c685e650-6379-4809-8cec-3549d4a26ab1 while it is in vm_state rescued Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:21:36.578401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:21:36.579510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:21:36.579510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:21:36.579510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c685e650-6379-4809-8cec-3549d4a26ab1 while it is in vm_state rescued Sep 23 15:21:36.579510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:21:36.579510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Returning 409 to user: Cannot 'attach_volume' instance c685e650-6379-4809-8cec-3549d4a26ab1 while it is in vm_state rescued {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:21:36.579510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fdfbd485-03cf-42b1-9b61-a1e688486ebf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057358 Sep 23 15:21:36.581080 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 251/470] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:21:36 2022] POST /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 15:21:36.586543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:36.587355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:36.594860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.595344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.595974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.596768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.597254 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.597679 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.674893 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dd974f64-267d-4f42-9efa-3809a4720d0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1/action" status: 202 len: 0 microversion: 2.1 time: 0.091928 Sep 23 15:21:36.675801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 220/471] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:21:36 2022] POST /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:21:36.684180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:36.685145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:36.691670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.692230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.692959 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.693742 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.694253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.694916 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.847490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:36.862474 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-80a2c1b5-c1aa-4b7d-8cbe-ff693135cd43 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1510 microversion: 2.1 time: 0.182318 Sep 23 15:21:36.863048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 252/472] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:36 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:36.918730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:36.919416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:36.926417 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.926909 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.927333 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.928256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:36.929067 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:36.929808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:36.934873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:37.081959 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:37.089815 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-76ce4fdc-8653-4ab0-97e1-498dc604fe12 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1259 microversion: 2.1 time: 0.175406 Sep 23 15:21:37.090408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 221/473] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:36 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:37.886091 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:37.886831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:37.894100 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:37.894397 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:37.895154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:37.896364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:37.896986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:37.897595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:38.112922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:38.113528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:38.124688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:38.125181 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:38.125608 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:38.135473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:38.135981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:38.136423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:38.472811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:38.499349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-abe948d3-ff4a-4896-8dcf-27702dfcae79 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1510 microversion: 2.1 time: 0.604172 Sep 23 15:21:38.500485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:38.510131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5fa9cb29-fed7-45be-b044-25e7e761c76b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1442 microversion: 2.1 time: 0.401096 Sep 23 15:21:38.517218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 253/474] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:37 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:38.517760 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 222/475] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:38 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1442 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:38.553841 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:38.555469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:38.567537 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:38.573033 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:38.573779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:38.575524 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:38.576198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:38.576842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:38.750612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:38.754252 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:38.765389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ef2f978d-c866-42ab-b411-16021ad028ef tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1442 microversion: 2.1 time: 0.215822 Sep 23 15:21:38.766201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 254/476] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:38 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1442 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:39.532094 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:39.533328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:39.551546 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:39.552242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:39.553052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:39.553919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:39.554513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:39.554937 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:39.959698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:39.973987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1dadce78-3329-44ec-9f10-1549765bec68 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1510 microversion: 2.1 time: 0.446284 Sep 23 15:21:39.997085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 223/477] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:39 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1510 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:41.013030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:41.013752 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:41.030119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:41.030805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:41.031250 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:41.031966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:41.039376 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:41.041068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:41.416240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:41.425527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-776a0999-9fa4-42e8-8d32-7818993869a2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1510 microversion: 2.1 time: 0.421532 Sep 23 15:21:41.427204 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 255/478] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:41 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:41.472557 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-5f339b9f-f6bb-4a0c-a485-f3e37743e11b req-0ea65331-dfc2-4633-b925-80dee8390fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0a3e47-96a7-461b-81dc-e879cf1df317", "tag": "aa222fb4-42c6-4891-beb9-013184d89cc9"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:41.486773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-5f339b9f-f6bb-4a0c-a485-f3e37743e11b req-0ea65331-dfc2-4633-b925-80dee8390fcd service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:41.487590 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-5f339b9f-f6bb-4a0c-a485-f3e37743e11b req-0ea65331-dfc2-4633-b925-80dee8390fcd service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:41.488192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-5f339b9f-f6bb-4a0c-a485-f3e37743e11b req-0ea65331-dfc2-4633-b925-80dee8390fcd service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:41.508875 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-5f339b9f-f6bb-4a0c-a485-f3e37743e11b req-0ea65331-dfc2-4633-b925-80dee8390fcd service nova] Creating event network-changed:aa222fb4-42c6-4891-beb9-013184d89cc9 for instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 on hv-cinder-85501 Sep 23 15:21:41.515199 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-5f339b9f-f6bb-4a0c-a485-f3e37743e11b req-0ea65331-dfc2-4633-b925-80dee8390fcd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046277 Sep 23 15:21:41.516661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 224/479] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:21:42.457007 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:42.458552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:42.477299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:42.479689 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:42.480335 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:42.481792 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:42.482610 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:42.483357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:42.975919 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:42.989382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-31b2e747-30df-4778-8223-99c7f0b42ff6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1516 microversion: 2.1 time: 0.541929 Sep 23 15:21:42.990940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 256/480] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:42 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1516 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:44.523576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fbef2909-4866-4803-bd33-b25e03fa82f1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'create', calling method: .version_select at 0x7fbb03007280>, body: {"keypair": {"name": "tempest-keypair-1071805779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7iqHlc6khtX4+34cZKK5uUdvNxAKyiPui0cZ3HziGlZiMgGcnSCpx4a+kPX5iveCzTVaBzF0j2ih+99AdYP6a1MVpYSJJictwiMCe8RCzeMRDaiSVCeRunPuFRIRQTRg=="}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:44.562669 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-fbef2909-4866-4803-bd33-b25e03fa82f1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Getting quotas for project 1abe4f1508864f77b30c4c635c368f02. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:21:44.565116 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-fbef2909-4866-4803-bd33-b25e03fa82f1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Getting quotas for user 4cfac62e1c304167abb971815d5da358 and project 1abe4f1508864f77b30c4c635c368f02. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:21:44.610460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fbef2909-4866-4803-bd33-b25e03fa82f1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091536 Sep 23 15:21:44.611201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 225/481] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:21:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:21:46.371483 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2017558835", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3ffbd85-3b9b-417b-b45f-55b60c247ef0"}], "security_groups": [{"name": "tempest-securitygroup--372314473"}], "key_name": "tempest-keypair-1071805779", "user_data": "}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:50.522628 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] validate_networks() for [('d3ffbd85-3b9b-417b-b45f-55b60c247ef0', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:21:51.006755 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:21:51.007180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:21:51.007648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:21:51.008052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:21:51.008458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:21:51.017992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:51.018471 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:51.018903 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:51.019629 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:51.020080 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:51.020501 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:51.037809 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Getting quotas for project 1abe4f1508864f77b30c4c635c368f02. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:21:51.042375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Getting quotas for user 4cfac62e1c304167abb971815d5da358 and project 1abe4f1508864f77b30c4c635c368f02. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:21:51.054062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:21:51.056373 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:21:51.105884 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-79264a9c-26cd-4a96-9a62-0e4be652e880 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.738891 Sep 23 15:21:51.112413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 257/482] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:21:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 4740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:21:51.132066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f9e43f22-2c4e-4e03-862c-6f0ad7d78398 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:51.133647 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f9e43f22-2c4e-4e03-862c-6f0ad7d78398 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:51.199286 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f9e43f22-2c4e-4e03-862c-6f0ad7d78398 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:51.209362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f9e43f22-2c4e-4e03-862c-6f0ad7d78398 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1246 microversion: 2.1 time: 0.086634 Sep 23 15:21:51.209943 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 226/483] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:51 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:52.236196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:52.236900 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:52.243574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:52.244061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:52.244497 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:52.245278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:52.245743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:52.246166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:52.324146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:52.332305 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f677e067-83d7-499b-8194-c9330953ce4c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1298 microversion: 2.1 time: 0.100281 Sep 23 15:21:52.333015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 258/484] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:52 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:21:53.356178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:53.357324 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:53.359820 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=18 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:53.376994 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:53.377864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:53.378469 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:53.379358 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:53.379987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:53.380573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:53.531690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:53.539458 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8224d456-f299-40d2-bfd5-99e97819be60 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1304 microversion: 2.1 time: 0.188069 Sep 23 15:21:53.547671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 227/485] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:53 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:54.563347 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:54.564028 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:54.570788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:54.571520 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:54.571956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:54.572679 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:54.573482 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:54.574112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:54.902325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:54.914448 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9c30156c-233c-4f2a-82e8-bddd99525696 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.354810 Sep 23 15:21:54.915929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 259/486] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:54 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:55.070948 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-c5705ed4-3392-4ee9-a618-eda9ab8e70f5 req-25113304-0d62-4684-a997-5abc2b83f7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25", "tag": "306b9553-4640-49fe-82dd-dd744475cdb3"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:21:55.093266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c5705ed4-3392-4ee9-a618-eda9ab8e70f5 req-25113304-0d62-4684-a997-5abc2b83f7f6 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:55.094284 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c5705ed4-3392-4ee9-a618-eda9ab8e70f5 req-25113304-0d62-4684-a997-5abc2b83f7f6 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:55.095028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c5705ed4-3392-4ee9-a618-eda9ab8e70f5 req-25113304-0d62-4684-a997-5abc2b83f7f6 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:55.130424 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-c5705ed4-3392-4ee9-a618-eda9ab8e70f5 req-25113304-0d62-4684-a997-5abc2b83f7f6 service nova] Creating event network-changed:306b9553-4640-49fe-82dd-dd744475cdb3 for instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 on hv-cinder-85501 Sep 23 15:21:55.138452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-c5705ed4-3392-4ee9-a618-eda9ab8e70f5 req-25113304-0d62-4684-a997-5abc2b83f7f6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080076 Sep 23 15:21:55.143931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 228/487] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:21:55.939416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:55.940268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:55.948222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:55.949014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:55.949751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:55.950684 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:55.951167 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:55.951677 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:56.158936 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:56.175573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-aa03fb68-f672-4f0f-bab9-f95027714d01 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.240917 Sep 23 15:21:56.177168 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 260/488] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:55 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:57.200861 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:57.201754 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:57.208964 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:57.209622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:57.210154 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:57.211131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:57.211856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:57.212391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:57.443378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:57.451463 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b5fd72c9-11cd-4bc0-bedf-d9625835b9ca tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.255677 Sep 23 15:21:57.451991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 229/489] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:57 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:58.475143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:58.475747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:58.481946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:58.482498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:58.483001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:58.483843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:58.484908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:58.484908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:58.644495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:58.652929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-21c63053-ee69-4320-a223-18486bd54df0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.181467 Sep 23 15:21:58.653652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 261/490] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:58 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:21:59.678973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:21:59.679591 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:21:59.682053 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:21:59.689844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:59.690308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:59.690874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:59.691774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:21:59.692386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:21:59.692854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:21:59.941321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:21:59.949565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-795f5bd7-7c4d-4eb9-8aaf-00f258f08cc5 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.274728 Sep 23 15:21:59.950421 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 230/491] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:21:59 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:00.975517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:00.976174 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:00.982728 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:00.983393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:00.984912 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:00.985803 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:00.986278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:00.986691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:01.028289 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:01.065810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=6 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:01.191062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:01.199291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2560755f-4645-4847-849b-bd7d7343f61e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.227837 Sep 23 15:22:01.200414 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 262/492] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:00 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:02.224284 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:02.225131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:02.229715 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:02.236688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:02.237420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:02.238049 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:02.238955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:02.239568 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:02.240155 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:02.764355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:02.773630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3d034cf9-56ab-4d73-8a55-f16169419071 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.553944 Sep 23 15:22:02.784614 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 231/493] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:02 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:03.798341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:03.799779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:03.802089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:03.808920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:03.809988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:03.810905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:03.812093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:03.813072 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:03.813700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:04.433029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:04.445098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-49feee6b-a1d0-430f-820f-084bd5fdba87 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.649388 Sep 23 15:22:04.447093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 263/494] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:03 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:05.479382 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:05.485821 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:05.516303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:05.518233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:05.519367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:05.528875 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:05.533456 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:05.536099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:05.909141 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:05.920848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a3795e41-c8cc-410d-9ef5-6d85a7cc3f12 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.446020 Sep 23 15:22:05.934295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 232/495] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:05 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:06.946416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:06.947024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:06.954649 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:06.955199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:06.955810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:06.956848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:06.957298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:06.957890 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:07.110749 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:07.119470 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-684ca26b-ab85-4343-b58e-7bf779e9407e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.176999 Sep 23 15:22:07.120670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 264/496] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:06 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:08.144369 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:08.145580 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:08.154108 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:08.154594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:08.155204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:08.156532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:08.157293 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:08.157864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:08.380661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:08.392473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-85f686ad-bf13-4ada-bd5e-4e746e6d4c0a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.250989 Sep 23 15:22:08.392777 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 233/497] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:08 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:09.417099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:09.417738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:09.424165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:09.424701 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:09.425172 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:09.426383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:09.426383 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:09.426694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:09.429559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=57 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:09.601426 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:09.610089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2f1e77b4-66e2-47f8-9e2b-c465d9bf0a21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.196899 Sep 23 15:22:09.611246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 265/498] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:09 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:10.634848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:10.635617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:10.644156 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:10.645229 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:10.645882 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:10.646810 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:10.647467 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:10.648135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:10.828338 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:10.837392 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-25e8d429-c5f3-44d0-a8a9-e5418b3f0f99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.207677 Sep 23 15:22:10.838572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 234/499] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:10 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:11.871884 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:11.872535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:11.885573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:11.888738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:11.889364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:11.890519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:11.891026 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:11.891401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:12.067523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:12.076043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-403fb2af-5541-47b7-9f6d-cd684c3cabfe tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.213773 Sep 23 15:22:12.076639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 266/500] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:11 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:13.020273 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-2518da8d-aeff-4ce7-903a-a9cb6e2b47ed req-084e5bd6-15e0-40d1-841d-700a23ab7b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25", "name": "network-vif-plugged", "status": "completed", "tag": "306b9553-4640-49fe-82dd-dd744475cdb3"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:13.036876 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-2518da8d-aeff-4ce7-903a-a9cb6e2b47ed req-084e5bd6-15e0-40d1-841d-700a23ab7b7b service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:13.037362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-2518da8d-aeff-4ce7-903a-a9cb6e2b47ed req-084e5bd6-15e0-40d1-841d-700a23ab7b7b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:13.037790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-2518da8d-aeff-4ce7-903a-a9cb6e2b47ed req-084e5bd6-15e0-40d1-841d-700a23ab7b7b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:13.075795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-2518da8d-aeff-4ce7-903a-a9cb6e2b47ed req-084e5bd6-15e0-40d1-841d-700a23ab7b7b service nova] Creating event network-vif-plugged:306b9553-4640-49fe-82dd-dd744475cdb3 for instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 on hv-cinder-85501 Sep 23 15:22:13.081837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-2518da8d-aeff-4ce7-903a-a9cb6e2b47ed req-084e5bd6-15e0-40d1-841d-700a23ab7b7b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065849 Sep 23 15:22:13.082817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 235/501] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:13.099640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:13.100252 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:13.107697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:13.108188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:13.108753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:13.109460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:13.110081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:13.110671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:13.259760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:13.267938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9bc3f8bc-d859-4033-b034-6bb2b03a28a8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.172769 Sep 23 15:22:13.268890 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 267/502] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:13 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:14.294257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:14.294771 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:14.311762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:14.312427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:14.313377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:14.314596 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:14.314596 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:14.315017 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:14.458189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:14.466684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9ac07de8-78a4-40c2-a0a9-7e224443d68c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.178728 Sep 23 15:22:14.467364 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 236/503] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:14 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:15.490943 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:15.491954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:15.498529 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:15.499790 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:15.500381 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:15.501276 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:15.502025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:15.502596 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:15.652326 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:15.661492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0e04741e-a5ce-4781-b3d3-303783c7513d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.174893 Sep 23 15:22:15.662062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 268/504] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:15 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:16.685955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:16.686551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:16.694316 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:16.694921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:16.695375 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:16.696149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:16.696655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:16.697114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:16.863490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:16.874795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-584f4219-5d93-46c9-83f5-bcad2b30bc11 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.193003 Sep 23 15:22:16.889201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 237/505] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:16 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:17.374175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-359f4951-2288-4bcd-bd3e-30ab6b005e21 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Action: 'create', calling method: .version_select at 0x7fbb030fdee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1972542435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeIOaXJ1VlZPyijF2IzvrUw0YH6/RgD3SOgT0kLwgWmGP+Pe1alPid85iTTF3WaRItNfEJ5bDpmV5eHNPBWdXi17cOg7HFDu8eRDSUkGZA3cQZOD66U9XENMxuAzdGOcw=="}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:17.391792 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-359f4951-2288-4bcd-bd3e-30ab6b005e21 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Getting quotas for project 1b76f9eee7a14eb581dcdc19101fc774. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:22:17.396924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-359f4951-2288-4bcd-bd3e-30ab6b005e21 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Getting quotas for user 09d964117e9f449aaf3c768ccd395983 and project 1b76f9eee7a14eb581dcdc19101fc774. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:22:17.428282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-359f4951-2288-4bcd-bd3e-30ab6b005e21 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057884 Sep 23 15:22:17.428910 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 269/506] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:22:17 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:17.484362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1119662273", "imageRef": "805f0b55-8c24-457d-9202-5730423d0097", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1972542435", "networks": [{"uuid": "6e977df4-776b-4447-99be-1d03ae7632bf"}]}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:17.540533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] validate_networks() for [('6e977df4-776b-4447-99be-1d03ae7632bf', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:22:17.899166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:17.899773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:17.906148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:17.906644 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:17.907079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:17.907790 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:17.908273 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:17.908741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:17.967872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:22:17.968408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:22:17.968767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:22:17.969270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:22:17.969683 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:22:17.978598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:17.979119 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:17.979553 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:17.980282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:17.980764 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:17.981187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:17.999563 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Getting quotas for project 1b76f9eee7a14eb581dcdc19101fc774. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:22:18.003791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Getting quotas for user 09d964117e9f449aaf3c768ccd395983 and project 1b76f9eee7a14eb581dcdc19101fc774. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:22:18.015565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:22:18.017828 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='805f0b55-8c24-457d-9202-5730423d0097',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:22:18.043601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:18.051823 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f36a1748-229e-422b-8663-c0f1fe2e7c24 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.156909 Sep 23 15:22:18.052393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 270/507] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:17 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:18.064930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR oslo.messaging._drivers.impl_rabbit [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [300b4e7c-7f88-4eb9-8096-a07359dceaba] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 15:22:19.077544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO oslo.messaging._drivers.impl_rabbit [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [300b4e7c-7f88-4eb9-8096-a07359dceaba] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 60326. Sep 23 15:22:19.078993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:19.079584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:19.082715 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-00ceb511-b475-480c-b8b3-fbb43f25267d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603291 Sep 23 15:22:19.083436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 238/508] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:22:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:22:19.089982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:19.090727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:19.091160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:19.091859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:19.092303 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:19.092739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:19.094455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a4c6f0d2-dc5f-4706-bfd9-02e0d1efdd72 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:19.095089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a4c6f0d2-dc5f-4706-bfd9-02e0d1efdd72 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:19.161520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a4c6f0d2-dc5f-4706-bfd9-02e0d1efdd72 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:19.169754 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a4c6f0d2-dc5f-4706-bfd9-02e0d1efdd72 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1259 microversion: 2.1 time: 0.079157 Sep 23 15:22:19.170524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 239/509] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:19 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:19.236099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:19.244332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-df5d8084-6654-449f-9b80-e716a771680f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.171814 Sep 23 15:22:19.244981 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 271/510] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:19 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:20.193863 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:20.194505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:20.201179 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:20.201664 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:20.202145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:20.202808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:20.203267 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:20.203680 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:20.267019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:20.267473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:20.267791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:20.273957 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:20.274514 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:20.275015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:20.275135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5935b3be-f7e1-4d11-90bc-6b1685c87b13 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1263 microversion: 2.1 time: 0.085366 Sep 23 15:22:20.275584 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 240/511] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:20 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:20.279094 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:20.279607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:20.280077 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:20.410784 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:20.418595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7d65d909-20ae-4ff7-836e-7bf342296b50 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1371 microversion: 2.1 time: 0.155771 Sep 23 15:22:20.419156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 272/512] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:20 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:21.297627 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:21.298222 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:21.305078 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:21.305890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:21.306242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:21.306864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:21.307472 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:21.307714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:21.376406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:21.385028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-09bd5c94-1871-403e-bf3f-748f5b627db2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1311 microversion: 2.1 time: 0.091412 Sep 23 15:22:21.386085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 241/513] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:21 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:21.441398 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:21.442103 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:21.448089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:21.448572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:21.449038 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:21.449726 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:21.450174 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:21.450597 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:21.599020 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:21.607365 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-08187cce-0f2a-4cda-8501-c1213f4a8f21 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1564 microversion: 2.1 time: 0.169961 Sep 23 15:22:21.607891 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 273/514] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:21 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:21.638956 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:21.639647 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:21.649562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:21.650340 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:21.651052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:21.652196 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:21.653028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:21.653725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:21.740873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-be34f1fc-6754-4eb3-994c-11866ac8a61c tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108706 Sep 23 15:22:21.741997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 242/515] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Sep 23 15:22:21 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:22.415406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:22.416249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:22.423396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:22.423954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:22.424608 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:22.425218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:22.425674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:22.426095 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:22.499757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:22.508519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c0bdc2ac-cd92-4ada-9916-0451734c348b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1317 microversion: 2.1 time: 0.098134 Sep 23 15:22:22.509111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 274/516] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:22 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1317 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:23.271555 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-e8e3ab9c-c85c-4846-afba-5af61cc99139 req-c56c114a-ef87-4863-afbc-38752fe6312b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25", "tag": "306b9553-4640-49fe-82dd-dd744475cdb3"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:23.293247 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e8e3ab9c-c85c-4846-afba-5af61cc99139 req-c56c114a-ef87-4863-afbc-38752fe6312b service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:23.293890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e8e3ab9c-c85c-4846-afba-5af61cc99139 req-c56c114a-ef87-4863-afbc-38752fe6312b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:23.294415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e8e3ab9c-c85c-4846-afba-5af61cc99139 req-c56c114a-ef87-4863-afbc-38752fe6312b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:23.311693 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-e8e3ab9c-c85c-4846-afba-5af61cc99139 req-c56c114a-ef87-4863-afbc-38752fe6312b service nova] Creating event network-changed:306b9553-4640-49fe-82dd-dd744475cdb3 for instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 on hv-cinder-85501 Sep 23 15:22:23.317904 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-e8e3ab9c-c85c-4846-afba-5af61cc99139 req-c56c114a-ef87-4863-afbc-38752fe6312b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050716 Sep 23 15:22:23.320342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 243/517] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:23.533374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:23.534118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:23.549862 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:23.551490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:23.553654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:23.554775 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:23.555465 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:23.557269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:23.792090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:23.801680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-72b8fb32-4549-45b4-ad37-b60887d511e8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.273887 Sep 23 15:22:23.802291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 275/518] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:23 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:24.837656 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:24.838367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:24.845344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:24.845835 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:24.846271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:24.846970 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:24.847437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:24.847854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:24.852099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=79 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:24.981325 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:24.989166 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-60dab9ed-f34b-446a-96d2-f0e4cfed7ac6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.168182 Sep 23 15:22:24.989736 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 244/519] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:24 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:26.011573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:26.012320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:26.018982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:26.019481 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:26.019892 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:26.020582 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:26.021051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:26.021464 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:26.164130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:26.175988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4b971791-5b14-4cf3-bd88-c8cbb6eca35f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.168260 Sep 23 15:22:26.176576 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 276/520] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:26 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:27.203993 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:27.205398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:27.213052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:27.213542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:27.213984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:27.214702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:27.215192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:27.215581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:27.356334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:27.365024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-370ed3e2-556f-4e69-8574-58b3e42fa7cd tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.167188 Sep 23 15:22:27.365611 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 245/521] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:27 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:28.388032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:28.389779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:28.391588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=4 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:28.397364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:28.397859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:28.398298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:28.399216 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:28.399697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:28.400121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:28.540108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:28.549162 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-17f10f04-c04c-4537-a593-58d6ab67cbf5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.164985 Sep 23 15:22:28.549739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 277/522] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:28 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:29.571670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:29.572313 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:29.577186 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:29.579098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=8 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:29.587113 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:29.587752 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:29.588280 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:29.589103 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:29.589644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:29.590189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:29.727189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:29.736265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9c57d5a0-3c9b-4c04-8ece-44053c846719 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.168602 Sep 23 15:22:29.736739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 246/523] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:29 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:30.760302 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:30.761222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:30.768400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:30.769435 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:30.770224 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:30.771164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:30.771806 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:30.772413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:30.929003 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:30.936533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4b95486c-fd75-4ae9-b69e-c30a017c91c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.180820 Sep 23 15:22:30.937163 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 278/524] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:30 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:31.959941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:31.962769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:31.967705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:31.973104 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:31.974194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:31.974983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:31.975922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:31.976740 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:31.977326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:32.117995 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:32.125778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8aa93608-564f-4987-913a-43d0c782665d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.170401 Sep 23 15:22:32.126440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 247/525] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:31 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:33.150190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:33.151594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:33.159139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:33.160284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:33.161014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:33.162014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:33.162946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:33.163708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:33.330198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:33.341335 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-737dceef-e75a-4735-a54d-9858eb86cea6 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.195885 Sep 23 15:22:33.342115 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 279/526] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:33 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:22:34.365143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:34.365752 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:34.373089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:34.373640 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:34.374073 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:34.374799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:34.375263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:34.375705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:34.509912 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:34.517839 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ff4da25f-5957-425b-9c65-f78bf1e95531 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.156814 Sep 23 15:22:34.528795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 248/527] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:34 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:35.549507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:35.551149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:35.554129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:35.559396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:35.559878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:35.560337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:35.561111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:35.561566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:35.561983 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:35.694160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:35.702221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6cd32ea4-a01a-4931-80c4-4852b8b48ebc tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.159286 Sep 23 15:22:35.702788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 280/528] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:35 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:36.728184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:36.728819 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:36.736279 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:36.737056 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:36.737774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:36.738690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:36.739346 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:36.739774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:36.885485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:36.897877 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-54362e50-bad6-48ef-bf2d-f8c43b182e2a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.173799 Sep 23 15:22:36.898792 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 249/529] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:36 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:37.925343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:37.925989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:37.932402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:37.932924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:37.933350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:37.934220 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:37.934670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:37.935114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:38.079378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:38.087591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0329c5fb-24e3-47dc-8fd6-57995db1a221 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.166219 Sep 23 15:22:38.088393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 281/530] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:37 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:39.115005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:39.115987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:39.127178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.127984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.128738 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.129880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:39.130471 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:39.130892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:39.304350 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:39.313372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-30d2de20-d3fd-4db7-a49b-82aef638f6e4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.204868 Sep 23 15:22:39.314141 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 250/531] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:39 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:40.341548 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:40.342534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:40.352921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:40.353717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:40.354433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:40.355563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:40.356302 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:40.357045 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:40.361254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=96 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:40.502180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:40.511478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e0b76507-2ba0-4b28-9cae-870ff03e8fbf tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.176583 Sep 23 15:22:40.512050 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 282/532] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:40 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:41.535867 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:41.536576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:41.545509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:41.546051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:41.546602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:41.547341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:41.547804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:41.548239 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:41.689475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:41.700136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b043c797-1abd-40b1-9a7c-6eaa54b0ab8c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.168362 Sep 23 15:22:41.700644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 251/533] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:41 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:42.723588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:42.725731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:42.731984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:42.732547 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:42.733214 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:42.733917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:42.734364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:42.734998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:42.879585 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:42.889387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-61132084-8cae-4e43-9cc9-9c658bbcc92d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.169234 Sep 23 15:22:42.890366 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 283/534] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:42 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:42.896291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-454a667f-7744-493b-b1de-43dfbc18e651 req-1c3d1f8d-74a8-4a01-a0eb-e1b8d2d331b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af869e43-152c-46fe-9759-c0b506650b1d", "tag": "6cacb33d-3b2c-43b4-8086-7c7978b2aae6"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:42.909918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-454a667f-7744-493b-b1de-43dfbc18e651 req-1c3d1f8d-74a8-4a01-a0eb-e1b8d2d331b9 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:42.910392 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-454a667f-7744-493b-b1de-43dfbc18e651 req-1c3d1f8d-74a8-4a01-a0eb-e1b8d2d331b9 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:42.910813 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-454a667f-7744-493b-b1de-43dfbc18e651 req-1c3d1f8d-74a8-4a01-a0eb-e1b8d2d331b9 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:42.923138 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-454a667f-7744-493b-b1de-43dfbc18e651 req-1c3d1f8d-74a8-4a01-a0eb-e1b8d2d331b9 service nova] Creating event network-changed:6cacb33d-3b2c-43b4-8086-7c7978b2aae6 for instance af869e43-152c-46fe-9759-c0b506650b1d on hv-cinder-85501 Sep 23 15:22:42.929144 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-454a667f-7744-493b-b1de-43dfbc18e651 req-1c3d1f8d-74a8-4a01-a0eb-e1b8d2d331b9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036404 Sep 23 15:22:42.929946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 252/535] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:43.918337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:43.919299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:43.929331 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:43.929819 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:43.930254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:43.930952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:43.931404 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:43.931835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:44.066754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:44.075203 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-44e5d648-315c-4b2a-b56e-8441d7caa9b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.163908 Sep 23 15:22:44.075817 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 284/536] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:43 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:45.103542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:45.104460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:45.113104 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:45.113774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:45.114351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:45.115294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:45.116122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:45.117100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:45.261475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:45.269238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3097275f-51db-4536-ad74-ba2de6a95dfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.173258 Sep 23 15:22:45.269807 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 253/537] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:45 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:46.292195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:46.292791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:46.299165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:46.299651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:46.300079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:46.300810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:46.301266 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:46.301688 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:46.436448 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:46.444811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6fe29da8-27fd-4fd5-a3cf-1d7c5eb47a5c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.156730 Sep 23 15:22:46.445379 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 285/538] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:46 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:47.468494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:47.469096 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:47.475510 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:47.475994 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:47.476427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:47.477294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:47.478120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:47.478547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:47.614528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:47.623239 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f6801e00-5ed2-4a4e-b91f-ba365330b29d tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.158971 Sep 23 15:22:47.623817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 254/539] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:47 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:48.650868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:48.651878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:48.662052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:48.662850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:48.663569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:48.664857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:48.665315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:48.665737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:48.811953 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:48.820334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c4dba1e2-eb55-4034-baad-a44a93dd540c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.176354 Sep 23 15:22:48.821001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 286/540] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:48 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:49.180463 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-6b6c0650-d488-45af-8cc1-786c52f41192 req-f5eed2eb-fa7b-472b-87d6-f986e402f288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af869e43-152c-46fe-9759-c0b506650b1d", "name": "network-vif-plugged", "status": "completed", "tag": "6cacb33d-3b2c-43b4-8086-7c7978b2aae6"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:49.193501 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-6b6c0650-d488-45af-8cc1-786c52f41192 req-f5eed2eb-fa7b-472b-87d6-f986e402f288 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:49.194034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-6b6c0650-d488-45af-8cc1-786c52f41192 req-f5eed2eb-fa7b-472b-87d6-f986e402f288 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:49.194567 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-6b6c0650-d488-45af-8cc1-786c52f41192 req-f5eed2eb-fa7b-472b-87d6-f986e402f288 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:49.210725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-6b6c0650-d488-45af-8cc1-786c52f41192 req-f5eed2eb-fa7b-472b-87d6-f986e402f288 service nova] Creating event network-vif-plugged:6cacb33d-3b2c-43b4-8086-7c7978b2aae6 for instance af869e43-152c-46fe-9759-c0b506650b1d on hv-cinder-85501 Sep 23 15:22:49.216310 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-6b6c0650-d488-45af-8cc1-786c52f41192 req-f5eed2eb-fa7b-472b-87d6-f986e402f288 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039748 Sep 23 15:22:49.217011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 255/541] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:49.847553 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:49.848500 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:49.858595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:49.859382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:49.860106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:49.861271 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:49.862018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:49.862709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:50.015642 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:50.023763 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-dbea75ed-eb2d-4b49-b31a-1d8227f1c059 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.182729 Sep 23 15:22:50.024871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 287/542] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:49 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:51.053318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:51.054454 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:51.065025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:51.065836 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:51.066560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:51.068007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:51.068802 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:51.069519 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:51.203527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:51.211326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-11b2b860-ad2d-4b77-8782-ea98464cae1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1359 microversion: 2.1 time: 0.165973 Sep 23 15:22:51.212096 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 256/543] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:51 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:51.534372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:51.535079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:51.542635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:51.543134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:51.543583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:51.544362 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:51.544874 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:51.545329 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:51.569812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c37dea6a-9861-4b2b-bbbe-14516b37695d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/ips" status: 200 len: 144 microversion: 2.1 time: 0.040272 Sep 23 15:22:51.570376 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 288/544] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:22:51 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:52.234786 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:52.235359 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:52.242408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.242891 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.243328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.244256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.244749 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.245210 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.394948 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:52.402883 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7254c6a5-97a5-405e-b15d-56bc9a0582c9 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1550 microversion: 2.1 time: 0.172350 Sep 23 15:22:52.403452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 257/545] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:52 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:52.426100 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:52.426802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:52.433836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.434339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.434762 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.435457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.435927 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.436340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.599765 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:52.610601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8cb230a9-2f5b-4a7a-b571-b156cfba4ed7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1550 microversion: 2.1 time: 0.188804 Sep 23 15:22:52.613070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 289/546] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:52 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1550 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:52.633506 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:52.639184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:52.640052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Searching by: {'deleted': False, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774'} {{(pid=120919) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 15:22:52.648643 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.649135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.649866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.650986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.651611 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.652370 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.748959 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.multi_cell_list [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 15:22:52.842502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4b00c4cb-9426-42cb-a42b-4a22d2c886b1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212960 Sep 23 15:22:52.843083 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 258/547] 10.222.0.75 () {58 vars in 1125 bytes} [Fri Sep 23 15:22:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:52.854897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:52.855506 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:52.861810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.862286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.862710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.863392 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:52.863840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:52.864262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:52.998572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:52.999171 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:52.999310 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:53.005367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:53.005851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:53.006281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:53.007018 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:53.007447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e4bf87c2-5b74-4989-bb7c-01f71a78686a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1550 microversion: 2.1 time: 0.156487 Sep 23 15:22:53.007557 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:53.007866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:53.008755 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 290/548] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:22:52 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:22:53.035497 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5cb40008-bb33-4a10-a336-ea6413d292a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/ips" status: 200 len: 152 microversion: 2.20 time: 0.041004 Sep 23 15:22:53.036076 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 259/549] 10.222.0.75 () {60 vars in 1289 bytes} [Fri Sep 23 15:22:52 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:22:53.837411 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac783224-f752-4016-b720-b2618fdca344"}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:53.839863 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:53.846071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:53.846554 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:53.846986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:53.847680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:53.848127 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:53.848549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:54.171897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-273f78a0-7bfd-47e0-bd31-3262395bcf1c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338579 Sep 23 15:22:54.172529 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 291/550] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:22:53 2022] POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:55.687390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9656a8b-3fe2-4ada-ae0d-dbeb06411367"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:55.691079 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:55.702028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.702747 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.703348 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.704352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.705061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.705589 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.709333 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=88 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:55.984262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:22:55.984929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:55.992413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.992974 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.993410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:55.994188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:55.994632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:55.995118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.012004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c2610e73-4bbb-4acd-a164-bec50a257c2e tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "POST /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330681 Sep 23 15:22:56.018026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 260/551] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:22:55 2022] POST /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:22:56.020230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lazy-loading 'flavor' on Instance uuid 95199f41-0774-4f39-912e-97a924ef09eb {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:22:56.259451 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f0e3088d-8854-45a6-8e03-bcd1f37f44d4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/action" status: 202 len: 0 microversion: 2.20 time: 0.279802 Sep 23 15:22:56.260051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 292/552] 10.222.0.75 () {62 vars in 1319 bytes} [Fri Sep 23 15:22:55 2022] POST /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:22:56.270276 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:56.270918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:56.277260 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.277921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.278364 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.279052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:56.279507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:56.279935 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:56.414535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:56.422870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:56.424309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:56.425500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-141c4895-5e00-4558-a201-61710bdd3233 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.160133 Sep 23 15:22:56.426063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 261/553] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:56 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:57.452355 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:57.453106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:57.460538 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:57.461056 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:57.461489 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:57.462183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:57.462633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:57.463052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:57.594925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:57.603267 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:57.604947 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:57.606279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-77082672-5d4a-4b7c-9fe3-1691cfc9b866 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.159147 Sep 23 15:22:57.606843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 293/554] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:57 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:22:58.633778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:58.634535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:58.644396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.645244 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.646154 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.647295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:58.648040 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:58.648811 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:58.811750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:58.825128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:58.827603 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:22:58.829556 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-77b69a25-212f-41bc-8bf1-f2767683d418 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.200899 Sep 23 15:22:58.830457 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 262/555] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:58 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:22:59.866747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:22:59.868110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:22:59.879607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:59.880444 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:59.881228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:22:59.882425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:22:59.883175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:22:59.883879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:00.203930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:00.215796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:00.217265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:00.218417 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c2a81867-ba57-416b-bead-f24c3a96ae0c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.358443 Sep 23 15:23:00.219005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 294/556] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:22:59 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:01.257974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:01.259437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:01.267838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:01.268318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:01.268798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:01.269491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:01.269939 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:01.270357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:01.458518 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:01.467418 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:01.468899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:01.470055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2a646803-ce50-4a91-9b8a-f29f0528acdf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.218790 Sep 23 15:23:01.470613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 263/557] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:01 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:02.496637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:02.497209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:02.503878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.504363 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.504835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.505534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.505989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.506463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.658304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:02.660671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:02.669107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:02.670592 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:02.671763 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-43346f3b-f7b1-4029-a6f7-7db0a7902cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.179898 Sep 23 15:23:02.672376 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 295/558] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:02 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:02.838270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5b5e8c47-9bd8-4ef9-ad98-5829c355f6ff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:02.841047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:02.841861 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=34 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:02.848309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5b5e8c47-9bd8-4ef9-ad98-5829c355f6ff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.848830 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5b5e8c47-9bd8-4ef9-ad98-5829c355f6ff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.849266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5b5e8c47-9bd8-4ef9-ad98-5829c355f6ff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.913054 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5b5e8c47-9bd8-4ef9-ad98-5829c355f6ff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Going to try to stop instance {{(pid=120919) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 15:23:02.960508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5b5e8c47-9bd8-4ef9-ad98-5829c355f6ff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.126018 Sep 23 15:23:02.961159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 264/559] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:23:02 2022] POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:23:02.971951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:02.972469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:02.979375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.979987 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.980412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:02.981354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:02.981943 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:02.982579 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:03.126605 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.135313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-dbf1aa83-d24d-4124-8011-b41f1e8d1d86 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.169716 Sep 23 15:23:03.135868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 296/560] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:02 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:03.698324 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:03.699035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:03.705895 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:03.706363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:03.707011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:03.707714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:03.708171 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:03.708613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:03.923428 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.932124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.933605 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:03.935019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-612aad24-a4b7-4db7-b7e3-ceb3e0660d8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.240976 Sep 23 15:23:03.935581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 265/561] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:03 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:04.159316 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:04.159917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:04.166761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:04.167236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:04.167665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:04.168341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:04.168854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:04.169271 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:04.319332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:04.328791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f37e9d3b-f5ae-4528-aa24-59c33cb44b12 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.173283 Sep 23 15:23:04.329366 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 297/562] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:04 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:04.964684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:04.965998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:04.976765 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:04.977576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:04.978300 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:04.979448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:04.980207 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:04.980974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:05.123114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.131906 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.133428 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.134603 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ffe102ef-4607-49ec-9fee-51d2b670f1d7 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.176607 Sep 23 15:23:05.135169 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 266/563] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:04 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:05.357078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:05.358039 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:05.369367 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:05.370181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:05.370906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:05.372122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:05.372621 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:05.373058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:05.516523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:05.525353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-aeaf6ceb-c498-4a4e-ac2b-c2e1a12cc2e8 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.174783 Sep 23 15:23:05.525932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 298/564] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:05 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:06.160554 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:06.161184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:06.168229 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.168821 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.169449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.170165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.170622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.171048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.301385 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.310562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.312007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.313201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a3aceb08-f93b-4fbd-8b7a-9e33ce0864b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.156626 Sep 23 15:23:06.313738 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 267/565] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:06 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:06.553833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:06.554837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:06.558582 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=38 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:06.565739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.566227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.566661 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.567361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:06.567819 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:06.568240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:06.704763 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:06.713249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1bf70c3f-3682-48c1-9240-aae31f688069 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.166368 Sep 23 15:23:06.713813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 299/566] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:06 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:07.343442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:07.344106 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:07.350956 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.351443 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.351880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.352576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.353063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.353492 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.507122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.515721 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.517204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.518366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-396fd92e-a893-4217-8f7e-eea8a1d78dbb tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.181669 Sep 23 15:23:07.518953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 268/567] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:07 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:07.738503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:07.738886 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:07.746017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.746580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.747071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.747941 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:07.748444 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:07.749436 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:07.877829 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:07.886245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4c79b1ac-9296-4c84-ace2-b1949c5b6c0b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.151877 Sep 23 15:23:07.886813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 300/568] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:07 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:08.543048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:08.543611 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:08.550936 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.551427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.551864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.552570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.553051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.553479 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.688903 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:08.697396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:08.698828 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:08.699984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4521527a-351a-44d5-a26a-3060c42b9edf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.160936 Sep 23 15:23:08.700518 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 269/569] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:08 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:08.913432 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:08.914473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:08.925464 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.926262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.926993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:08.928130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:08.929406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:08.930110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:09.070936 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:09.079568 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b9c831d8-36a9-42e7-8af5-05bfc862a145 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.172687 Sep 23 15:23:09.080106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 301/570] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:08 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:09.729597 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:09.730692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:09.742509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:09.743304 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:09.744022 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:09.745257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:09.745997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:09.746694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:09.890888 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:09.899597 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:09.901086 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:09.902245 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f2d969ce-1537-48c3-9610-730af947c6b0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.179435 Sep 23 15:23:09.902800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 270/571] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:09 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:10.047700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:10.048312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:10.055212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.055709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.056140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.056871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.057349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.057806 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.105314 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:10.105923 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:10.113246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.113737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.114176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.114874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.115356 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.115954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.199195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:10.208400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1f780f20-b8e8-4388-b899-91966153dded tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1596 microversion: 2.1 time: 0.165031 Sep 23 15:23:10.209147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 302/572] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:10 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1596 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:10.264519 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:10.274998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8b739cab-972a-459f-b776-42793b6da825 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.175056 Sep 23 15:23:10.275653 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 271/573] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:10 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:10.929173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:10.929805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:10.936003 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.936479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.936938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:10.937925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:10.938530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:10.938948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.162040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.170730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.172173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.173369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-20342489-f494-42cb-ac89-2cbe79b06f4d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.248252 Sep 23 15:23:11.173911 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 303/574] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:10 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:11.299420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:11.300147 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:11.308137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:11.308346 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:11.308647 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.309335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:11.309781 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:11.310452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:11.457743 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:11.466802 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9d3ae3c3-08c9-494e-9196-6af06c8c0250 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.171598 Sep 23 15:23:11.467527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 272/575] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:11 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:12.322183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:12.323201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:12.330162 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.330653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.331169 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.332166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.332632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.333053 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.377725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-7365e415-548d-4818-a009-cdb85c0154ad req-e236d6a6-4450-4327-8c14-b48a05a784ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af869e43-152c-46fe-9759-c0b506650b1d", "tag": "6cacb33d-3b2c-43b4-8086-7c7978b2aae6"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:12.395492 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7365e415-548d-4818-a009-cdb85c0154ad req-e236d6a6-4450-4327-8c14-b48a05a784ed service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.396131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7365e415-548d-4818-a009-cdb85c0154ad req-e236d6a6-4450-4327-8c14-b48a05a784ed service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.396791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7365e415-548d-4818-a009-cdb85c0154ad req-e236d6a6-4450-4327-8c14-b48a05a784ed service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.411507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-7365e415-548d-4818-a009-cdb85c0154ad req-e236d6a6-4450-4327-8c14-b48a05a784ed service nova] Creating event network-changed:6cacb33d-3b2c-43b4-8086-7c7978b2aae6 for instance af869e43-152c-46fe-9759-c0b506650b1d on hv-cinder-85501 Sep 23 15:23:12.418967 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-7365e415-548d-4818-a009-cdb85c0154ad req-e236d6a6-4450-4327-8c14-b48a05a784ed service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047014 Sep 23 15:23:12.421029 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 273/576] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:23:12.489041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:12.495378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:12.496139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:12.500832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:12.502540 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:12.503776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.504271 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e96b8fbb-e293-4c3a-8b6f-71e8ab3f3ad4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.308209 Sep 23 15:23:12.504683 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.505281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.506114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:12.506841 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:12.507700 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:12.524670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 304/577] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:12 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:12.816754 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:12.829048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e276ef51-ba84-4cea-bd49-51c120574cef tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.340690 Sep 23 15:23:12.829907 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 274/578] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:12 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:13.539478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:13.540235 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:13.554111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.554962 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.555646 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.556378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.556941 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.557402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.584403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1495144302"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:13.585040 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:13.591303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.591779 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.592263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.592986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.593510 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.593999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.596600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:13.695897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:13.704345 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:13.705825 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:13.707002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bb8df28f-59df-47bd-8fe6-8f874040f407 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1744 microversion: 2.20 time: 0.177626 Sep 23 15:23:13.707780 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 305/579] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:13 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:13.738218 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.network.security_group_api [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Adding security group 7176e855-f66e-4c07-87b2-ef74ca17013b to port 6cacb33d-3b2c-43b4-8086-7c7978b2aae6 Sep 23 15:23:13.853455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:13.854064 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:13.860634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.861169 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.861551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.862255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:13.862709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:13.863132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:13.994235 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:14.002853 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-202aa3fa-638b-4521-99eb-f43126e9ef57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.153249 Sep 23 15:23:14.003429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 306/580] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:13 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:23:14.062658 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4b31f550-cbc0-449d-b59d-c6eee7e2f452 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "POST /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.482294 Sep 23 15:23:14.066250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 275/581] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:23:13 2022] POST /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:23:14.071817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-e9cd9ccb-1f9a-4baa-8dd3-f9aed8502651 req-3c1cc1f7-ae77-4262-abac-a4703f6deef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af869e43-152c-46fe-9759-c0b506650b1d", "tag": "6cacb33d-3b2c-43b4-8086-7c7978b2aae6"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:14.082267 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e9cd9ccb-1f9a-4baa-8dd3-f9aed8502651 req-3c1cc1f7-ae77-4262-abac-a4703f6deef7 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:14.082600 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:14.082975 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e9cd9ccb-1f9a-4baa-8dd3-f9aed8502651 req-3c1cc1f7-ae77-4262-abac-a4703f6deef7 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:14.083327 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:14.083441 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e9cd9ccb-1f9a-4baa-8dd3-f9aed8502651 req-3c1cc1f7-ae77-4262-abac-a4703f6deef7 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:14.089450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:14.090205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:14.090705 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:14.091476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:14.092002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:14.092493 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:14.102281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-e9cd9ccb-1f9a-4baa-8dd3-f9aed8502651 req-3c1cc1f7-ae77-4262-abac-a4703f6deef7 service nova] Creating event network-changed:6cacb33d-3b2c-43b4-8086-7c7978b2aae6 for instance af869e43-152c-46fe-9759-c0b506650b1d on hv-cinder-85501 Sep 23 15:23:14.107725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-e9cd9ccb-1f9a-4baa-8dd3-f9aed8502651 req-3c1cc1f7-ae77-4262-abac-a4703f6deef7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039580 Sep 23 15:23:14.108766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 276/582] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:23:14.244944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:14.255056 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b7df110c-35ed-4995-99f9-c4a314d064c2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1762 microversion: 2.1 time: 0.176262 Sep 23 15:23:14.255890 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 307/583] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:14 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1762 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:14.735647 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:14.736523 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:14.743226 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:14.744471 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:14.744471 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:14.745050 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:14.745471 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:14.746062 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:14.894054 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:14.906558 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:14.907742 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:14.908922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4758ccb7-c0f9-422d-b33b-827d1f610d53 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1744 microversion: 2.20 time: 0.178287 Sep 23 15:23:14.909531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 277/584] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:14 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:15.030247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:15.031284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:15.043145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:15.043950 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:15.044691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:15.045876 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:15.046774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:15.047184 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:15.191060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:15.199695 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-50261f55-c55d-44b9-aafa-d535446416ab tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.175919 Sep 23 15:23:15.200244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 308/585] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:15 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:15.939028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:15.940024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:15.951383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:15.952063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:15.952949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:15.954307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:15.954766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:15.955181 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:16.105965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:16.114306 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:16.115723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:16.116898 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8333c5f1-ed3b-4f48-a055-dec0d63a25f3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1744 microversion: 2.20 time: 0.184793 Sep 23 15:23:16.117802 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 278/586] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:15 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:16.332098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:16.332832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:16.339041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:16.339542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:16.339969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:16.340701 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:16.341155 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:16.341573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:16.477061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:16.489888 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cfa57d99-9baa-4184-b4a7-2000bdfec6e5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.268031 Sep 23 15:23:16.490559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 309/587] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:16 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:17.146907 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:17.147831 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:17.159116 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.159595 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.160027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:17.160755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.161201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.161623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:17.293671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:17.302959 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:17.304396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:17.305602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a292eb97-c100-4c70-b4d6-0ef1bc42adb6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1744 microversion: 2.20 time: 0.165867 Sep 23 15:23:17.306416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 279/588] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:17 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:17.517906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:17.518577 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:17.525368 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.525854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.526278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:17.526970 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.527413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.527830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:17.554516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-c1766798-c5c3-4d29-b66d-a7a7e8c9e055 req-8e9ce0eb-d144-485f-8d8f-a87fc3be4c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95199f41-0774-4f39-912e-97a924ef09eb", "name": "network-vif-plugged", "status": "completed", "tag": "93652ce2-3bd3-4207-96bf-3c25e56c5c28"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:17.564436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c1766798-c5c3-4d29-b66d-a7a7e8c9e055 req-8e9ce0eb-d144-485f-8d8f-a87fc3be4c58 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:17.565237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c1766798-c5c3-4d29-b66d-a7a7e8c9e055 req-8e9ce0eb-d144-485f-8d8f-a87fc3be4c58 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:17.565773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c1766798-c5c3-4d29-b66d-a7a7e8c9e055 req-8e9ce0eb-d144-485f-8d8f-a87fc3be4c58 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:17.577361 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-c1766798-c5c3-4d29-b66d-a7a7e8c9e055 req-8e9ce0eb-d144-485f-8d8f-a87fc3be4c58 service nova] Creating event network-vif-plugged:93652ce2-3bd3-4207-96bf-3c25e56c5c28 for instance 95199f41-0774-4f39-912e-97a924ef09eb on hv-cinder-85501 Sep 23 15:23:17.582452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-c1766798-c5c3-4d29-b66d-a7a7e8c9e055 req-8e9ce0eb-d144-485f-8d8f-a87fc3be4c58 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031907 Sep 23 15:23:17.583060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 280/589] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:17.663575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:17.671884 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9fff44ae-fb31-4110-b874-92c8b25f1e57 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1722 microversion: 2.1 time: 0.158046 Sep 23 15:23:17.672454 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 310/590] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:17 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:18.332226 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:18.332976 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:18.339609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.340089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.340526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.341258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.341712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.342778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.482332 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:18.491868 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:18.493726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:18.494865 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-04ce972c-643d-48a0-a18a-7b25c03e6e9c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1744 microversion: 2.20 time: 0.167688 Sep 23 15:23:18.495397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 281/591] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:18 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:18.696508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:18.697136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:18.704475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.705011 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.705440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.706146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.706598 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.707024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.841162 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:18.850229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cfb5d796-2e99-4888-bd72-7fa456b4e177 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1699 microversion: 2.1 time: 0.157739 Sep 23 15:23:18.850813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 311/592] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:18 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:18.873547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-43ec0606-c436-4fa1-abd0-a6a691fd0cff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:18.879991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-43ec0606-c436-4fa1-abd0-a6a691fd0cff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.880475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-43ec0606-c436-4fa1-abd0-a6a691fd0cff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.880965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-43ec0606-c436-4fa1-abd0-a6a691fd0cff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.903312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-43ec0606-c436-4fa1-abd0-a6a691fd0cff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Going to try to start instance {{(pid=120919) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 15:23:18.950001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-43ec0606-c436-4fa1-abd0-a6a691fd0cff tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.080213 Sep 23 15:23:18.950645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 282/593] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:23:18 2022] POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:23:18.960946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:18.961555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:18.967751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.968202 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.968614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.969310 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:18.969935 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:18.970458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:18.986425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:19.112458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:19.122880 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-25364d00-5f31-4473-8f26-dc84c611ea64 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1708 microversion: 2.1 time: 0.165857 Sep 23 15:23:19.123717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 312/594] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:18 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:19.520721 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:19.521415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:19.527682 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:19.528402 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:19.528859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:19.529546 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:19.529971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:19.530541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:19.718642 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:19.728485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:19.730007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:19.731185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-157b2455-cbac-4819-ae83-37e06eb2ab11 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1744 microversion: 2.20 time: 0.215284 Sep 23 15:23:19.731702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 283/595] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:19 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1744 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:20.152331 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:20.153331 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:20.162069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:20.162557 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:20.162993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:20.163691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:20.164152 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:20.164575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:20.315497 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:20.323967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-81d608f2-e0f5-4009-a25d-8db7695cdd18 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1708 microversion: 2.1 time: 0.178621 Sep 23 15:23:20.324514 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 313/596] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:20 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1708 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:20.758708 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:20.759311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:20.766266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:20.766790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:20.767198 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:20.767889 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:20.768339 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:20.768806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:20.903513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:20.912619 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:20.914098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:20.915266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6e75013d-d76c-47b0-b8ba-48e2d4105f29 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1744 microversion: 2.20 time: 0.160582 Sep 23 15:23:20.915832 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 284/597] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:20 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:21.349853 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:21.350458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:21.357585 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:21.358058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:21.358483 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:21.359228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:21.359731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:21.360254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:21.494351 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:21.503401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b56cfa0e-aeb3-4cf5-bc6d-241e2c499c22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1712 microversion: 2.1 time: 0.157645 Sep 23 15:23:21.504039 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 314/598] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:23:21 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:23:21.941078 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:21.942001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:21.948924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:21.949784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:21.950213 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:21.951083 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:21.951719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:21.952448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:22.089737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:22.099211 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:22.100709 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:22.102080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fc965600-2b8e-4a95-a9c7-431f8aadc0ac tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.165312 Sep 23 15:23:22.117050 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 285/599] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:21 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:23.129185 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:23.130690 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:23.137969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:23.138562 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:23.139075 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:23.139895 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:23.140458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:23.140976 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:23.299855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:23.308887 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:23.310737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:23.312000 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bcc8dd7d-740d-482f-8b60-09c8c2cdf329 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.187084 Sep 23 15:23:23.313954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 315/600] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:23 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:24.343243 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:24.343905 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:24.351428 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:24.351917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:24.352352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:24.353060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:24.353799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:24.354460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:24.526437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:24.538640 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:24.540664 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:24.542056 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-547dfd3e-aef5-484e-99a7-1a2480728c9b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.203315 Sep 23 15:23:24.557237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 286/601] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:24 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:25.568666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:25.570101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:25.576638 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:25.577364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:25.578037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:25.578944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:25.579612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:25.580302 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:25.720295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:25.730487 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:25.731939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:25.733148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-98b5b0d5-2845-42f5-acc2-5e5158bf5767 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.169234 Sep 23 15:23:25.733798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 316/602] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:25 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:26.759455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:26.760034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:26.767076 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:26.767556 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:26.768011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:26.768855 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:26.769634 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:26.770070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:26.908711 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:26.917988 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:26.919720 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:26.921079 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7cc25b84-8f70-42dc-a7df-903e33760e77 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.165819 Sep 23 15:23:26.937309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 287/603] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:26 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:27.958182 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:27.958837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:27.966175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:27.966691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:27.967137 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:27.967855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:27.968313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:27.968778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:28.120957 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:28.130469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:28.132236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:28.133535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f560ed5f-9ca6-4cad-8b7e-39def2402ef6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.180086 Sep 23 15:23:28.134337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 317/604] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:27 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:29.158763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:29.159431 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:29.167413 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:29.168048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:29.168563 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:29.170496 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:29.170828 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:29.171345 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:29.310078 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:29.318610 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:29.320041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:29.321229 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-49a43481-4a13-47a0-8b89-d3243784f16d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.166578 Sep 23 15:23:29.321789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 288/605] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:29 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:30.349422 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:30.350162 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:30.359196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:30.359693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:30.360116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:30.361025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:30.361469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:30.361894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:30.518605 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:30.527396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:30.528873 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:30.530236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9d240186-8e28-475a-ae23-900c479a3895 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.185465 Sep 23 15:23:30.531136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 318/606] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:30 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:31.563242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:31.563846 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:31.574850 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:31.575671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:31.576345 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:31.576570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:31.577040 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:31.577481 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:31.711761 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:31.720100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:31.721712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:31.722891 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1ab1fbe5-defc-4341-bf14-18bbbde99126 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1739 microversion: 2.20 time: 0.164066 Sep 23 15:23:31.723437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 289/607] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:31 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:32.752861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:32.753863 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:32.760897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:32.761384 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:32.761815 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:32.762506 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:32.762959 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:32.763411 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:32.896070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:32.904488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:32.905965 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:32.907128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-675d0531-c969-42d2-9083-2a064489a53a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1721 microversion: 2.20 time: 0.161021 Sep 23 15:23:32.907658 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 319/608] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:32 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:33.937599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:33.938568 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:33.942387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=52 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:33.951387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:33.952190 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:33.952974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:33.954121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:33.954879 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:33.955594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:34.090906 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:34.099406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:34.100889 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:34.102057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e1d4b34f-f389-450a-9434-fe747aab8d4a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1721 microversion: 2.20 time: 0.171015 Sep 23 15:23:34.102617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 290/609] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:33 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:35.143427 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:35.143427 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:35.154419 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:35.155286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:35.156006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:35.157214 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:35.157930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:35.158675 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:35.304574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:35.312980 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:35.314419 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:35.315565 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7ac5f686-81c0-4641-953e-0e2b5f1be0f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1721 microversion: 2.20 time: 0.179739 Sep 23 15:23:35.316178 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 320/610] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:35 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:35.460384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-afd800c3-4834-476c-b284-6ca1bda48d1b req-ddfca06d-dcdb-4b21-be9a-6c7981301d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95199f41-0774-4f39-912e-97a924ef09eb", "name": "network-vif-unplugged", "status": "completed", "tag": "93652ce2-3bd3-4207-96bf-3c25e56c5c28"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:35.471085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-afd800c3-4834-476c-b284-6ca1bda48d1b req-ddfca06d-dcdb-4b21-be9a-6c7981301d4e service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:35.471612 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-afd800c3-4834-476c-b284-6ca1bda48d1b req-ddfca06d-dcdb-4b21-be9a-6c7981301d4e service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:35.472039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-afd800c3-4834-476c-b284-6ca1bda48d1b req-ddfca06d-dcdb-4b21-be9a-6c7981301d4e service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:35.483475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-afd800c3-4834-476c-b284-6ca1bda48d1b req-ddfca06d-dcdb-4b21-be9a-6c7981301d4e service nova] Creating event network-vif-unplugged:93652ce2-3bd3-4207-96bf-3c25e56c5c28 for instance 95199f41-0774-4f39-912e-97a924ef09eb on hv-cinder-85501 Sep 23 15:23:35.488838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-afd800c3-4834-476c-b284-6ca1bda48d1b req-ddfca06d-dcdb-4b21-be9a-6c7981301d4e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032366 Sep 23 15:23:35.489495 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 291/611] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:23:36.346171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:36.347113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:36.355967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:36.356560 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:36.357128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:36.357975 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:36.358534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:36.359054 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:36.502229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:36.511633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:36.513114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:36.514270 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7cae3093-846c-46d2-86d4-fcea520456e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1664 microversion: 2.20 time: 0.174882 Sep 23 15:23:36.514842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 321/612] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:36 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1664 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:36.540537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc7dd7c2-724a-4440-825d-7746ae07f08d"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:36.542996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:36.549433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:36.549920 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:36.550384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:36.551784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:36.552287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:36.552746 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:36.638172 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:36.866747 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3fc8f89c-2bb5-476b-9bf4-1647d65514b3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331179 Sep 23 15:23:36.867287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 292/613] 10.222.0.75 () {62 vars in 1364 bytes} [Fri Sep 23 15:23:36 2022] POST /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:23:37.002030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:23:37.002617 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:37.004743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=46 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:37.010170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:37.010630 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:37.011059 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:37.011725 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:37.012170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:37.012581 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:37.102102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120918) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 15:23:37.179221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3be63da1-74e5-4522-be60-8f278c4ffe6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/action" status: 202 len: 0 microversion: 2.20 time: 0.180995 Sep 23 15:23:37.180101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 322/614] 10.222.0.75 () {62 vars in 1319 bytes} [Fri Sep 23 15:23:36 2022] POST /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:23:37.192139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:37.192807 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:37.199652 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:37.200141 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:37.200576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:37.201307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:37.201757 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:37.202176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:37.340977 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:37.349858 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:37.351320 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:37.352482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-40b83007-7765-46c6-9c71-a4d260b7b4ed tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1750 microversion: 2.20 time: 0.165998 Sep 23 15:23:37.353084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 293/615] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:37 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:38.379477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:38.380062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:38.386313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:38.386802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:38.387230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:38.387925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:38.388366 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:38.388811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:38.526665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:38.536206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:38.538180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:38.539363 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a2a7fa40-0bc1-4897-9891-0c2d57271c05 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1752 microversion: 2.20 time: 0.164932 Sep 23 15:23:38.539931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 323/616] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:38 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:39.564985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:39.565562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:39.572618 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:39.573126 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:39.573562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:39.574257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:39.574704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:39.575125 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:39.714992 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:39.723674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:39.725259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:39.726432 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-553ecebb-500e-4842-87f1-5751bf505220 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.165460 Sep 23 15:23:39.726983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 294/617] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:39 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:40.761724 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:40.762655 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:40.772578 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:40.773090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:40.773517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:40.774206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:40.774648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:40.775063 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:40.912238 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:40.921518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:40.922960 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:40.924121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0196fd03-73b6-4473-b46c-868f592a6a67 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.169927 Sep 23 15:23:40.924716 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 324/618] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:40 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:41.952800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:41.953421 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:41.961739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:41.962219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:41.962703 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:41.963430 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:41.963777 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:41.964226 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:42.102864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:42.111851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:42.113458 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:42.114694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-febbddef-25a5-428b-9ec6-d86528440c4b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.168174 Sep 23 15:23:42.115340 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 295/619] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:41 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:43.139508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:43.140118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:43.147041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:43.148012 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:43.148450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:43.149209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:43.149651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:43.150074 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:43.292641 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:43.302140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:43.303617 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:43.305051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ffa3b7e0-6e0f-4ba6-b806-0a67a83715a2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.169411 Sep 23 15:23:43.305859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 325/620] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:43 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:44.330669 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:44.331314 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:44.339207 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:44.339718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:44.340122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:44.340858 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:44.341286 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:44.341704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:44.476533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:44.485879 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:44.487326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:44.488560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7d9c5b56-3106-48a1-9b35-2b7655c3597c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.161871 Sep 23 15:23:44.489145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 296/621] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:44 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:45.519184 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:45.520098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:45.530181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:45.530935 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:45.531601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:45.532700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:45.533409 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:45.536674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:45.687879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:45.697131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:45.698557 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:45.699717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-13162a3d-566f-4ed3-9209-23c1ef714935 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.186751 Sep 23 15:23:45.700279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 326/622] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:45 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:46.729650 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:46.730257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:46.736736 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:46.737246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:46.737675 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:46.738388 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:46.738855 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:46.739279 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:46.876097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:46.886195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:46.887663 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:46.888934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-763790b9-9f93-4adc-bc5c-794a5db860ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.165580 Sep 23 15:23:46.891108 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 297/623] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:46 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:47.919955 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:47.921112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:47.932424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:47.933122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:47.933555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:47.934253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:47.934699 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:47.942294 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:48.087912 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:48.098056 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:48.099476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:48.100734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-18013009-219e-4dbc-a733-18b17e33bd2e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.187669 Sep 23 15:23:48.101293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 327/624] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:47 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:49.126843 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:49.127503 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:49.134536 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:49.134813 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:49.135246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:49.135896 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:49.136532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:49.137175 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:49.276713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:49.286767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:49.288752 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:49.290204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-260e9913-0529-4515-b220-a662eacefeba tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.167322 Sep 23 15:23:49.291064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 298/625] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:49 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:23:50.319686 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:50.320295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:50.327077 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:50.327557 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:50.327987 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:50.328705 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:50.329154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:50.329573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:50.332131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:50.481439 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:50.490091 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:50.491507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:50.492667 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8a3f74dd-6cf2-45de-9756-169b5b8a837b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.177051 Sep 23 15:23:50.493570 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 328/626] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:50 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:51.522491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:51.523391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:51.531908 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:51.532390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:51.532890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:51.533590 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:51.534038 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:51.534464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:51.683348 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:51.692782 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:51.694200 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:51.695342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9f43a3bb-9268-4c45-a437-864c67d488be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.179189 Sep 23 15:23:51.695904 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 299/627] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:51 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:52.721486 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:52.722118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:52.728972 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:52.729457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:52.729879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:52.730579 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:52.731020 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:52.731435 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:52.878061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:52.887062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:52.888483 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:52.889722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1943a94d-0448-4b5c-8843-47bceffb13cf tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.172494 Sep 23 15:23:52.890478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 329/628] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:52 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:53.919716 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:53.920825 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:53.931149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:53.931949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:53.932764 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:53.933911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:53.934661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:53.935368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:54.069941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:54.081199 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:54.082621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:54.083771 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-273def0f-153e-4e9b-b131-363ec12ea744 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.170596 Sep 23 15:23:54.084328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 300/629] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:53 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:55.113533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:55.114526 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:55.125082 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:55.125879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:55.126594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:55.127726 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:55.128484 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:55.129229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:55.259425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:55.268941 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:55.270389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:55.271533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-db304438-72f3-4d01-978e-8fcfe2593c41 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.165051 Sep 23 15:23:55.272086 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 330/630] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:55 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:56.300082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:56.300746 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:56.307688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:56.308225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:56.308620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:56.309351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:56.309803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:56.310227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:56.452017 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:56.461094 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:56.462513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:56.463666 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8849f6d3-9950-4984-97d3-bd28473d0ef0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.167673 Sep 23 15:23:56.464227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 301/631] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:56 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:57.498643 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:57.499710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:57.506694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:57.507178 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:57.507611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:57.508306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:57.508791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:57.509217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:57.644652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:57.653759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:57.655242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:57.657161 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bab16fce-beff-4e23-9ca2-291d856f023d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.164877 Sep 23 15:23:57.657730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 331/632] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:57 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:58.687241 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:58.688054 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:58.699551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:58.700356 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:58.701133 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:58.702291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:58.703107 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:58.703567 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:58.838164 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:58.847019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:58.848460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:23:58.849655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5fc11d99-391b-44f0-982b-800613a7f7d1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.169297 Sep 23 15:23:58.850228 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 302/633] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:58 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:23:59.879129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:23:59.879874 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:23:59.888487 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:59.889146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:59.889687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:23:59.890709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:23:59.891122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:23:59.891656 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:00.043964 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:00.054293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:00.055778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:00.056978 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6e6f97c0-5ddc-4745-9bf5-ab5cf0fea733 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.183749 Sep 23 15:24:00.057544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 332/634] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:23:59 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:01.087060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:01.087999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:01.099404 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:01.100512 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:01.101516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:01.102649 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:01.103406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:01.104122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:01.241201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:01.251328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:01.252563 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:01.253764 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-761f2127-99b8-466b-82b2-7419bfe614ec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.173343 Sep 23 15:24:01.254537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 303/635] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:01 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:02.280865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:02.281746 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:02.290009 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:02.290584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:02.291068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:02.291866 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:02.292393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:02.292903 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:02.433419 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:02.442699 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:02.444122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:02.445312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ebc025a2-e2eb-412c-8b26-54ae59203ddd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.169288 Sep 23 15:24:02.445876 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 333/636] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:02 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:03.473810 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:03.474560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:03.483061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:03.485082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:03.485637 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:03.486500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:03.487066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:03.487594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:03.635029 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:03.649431 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:03.651639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:03.653622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-21ec5c5e-6e39-46e9-b267-2a378892304b tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.185246 Sep 23 15:24:03.654488 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 304/637] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:03 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:04.685259 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:04.686250 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:04.697588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:04.698389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:04.699105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:04.700244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:04.701041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:04.701751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:04.848272 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:04.860049 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:04.861575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:04.862726 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-33428fa6-f40b-45c7-a772-7a13453e7054 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.184221 Sep 23 15:24:04.863255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 334/638] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:04 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:05.790320 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32163891-7e70-4867-9af1-2022afa8c03e"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:05.792954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:05.795006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=30 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:05.801363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.802057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.802690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:05.803688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.804361 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.805184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:05.888443 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:05.889074 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:05.896029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.896518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.896985 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:05.897717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:05.898167 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:05.898618 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:06.039517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:06.049238 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:06.050665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:06.051846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fcce55e6-92f0-499d-8aa3-009bd8e44204 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.167518 Sep 23 15:24:06.052430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 335/639] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:05 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:06.083489 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=91,nova_cell1:UPDATE=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:06.096022 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9f28bf28-7759-4180-acac-239684a8e871 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423408 Sep 23 15:24:06.096655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 305/640] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:24:05 2022] POST /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments => generated 194 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:07.081899 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:07.082673 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:07.085620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:07.093275 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.093899 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.094475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.095447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.095985 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.096533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.244301 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:07.254987 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:07.256548 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:07.257967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6a0f2a5a-9e8f-43da-aa57-937dc9643831 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.182682 Sep 23 15:24:07.258525 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 336/641] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:07 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:07.794541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-bf8371a3-4186-48b9-82d1-b922e860ffb2 req-c56747d1-8350-40a7-afb2-925050c8620d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95199f41-0774-4f39-912e-97a924ef09eb", "name": "network-vif-plugged", "status": "completed", "tag": "93652ce2-3bd3-4207-96bf-3c25e56c5c28"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:07.806508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-bf8371a3-4186-48b9-82d1-b922e860ffb2 req-c56747d1-8350-40a7-afb2-925050c8620d service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:07.807019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-bf8371a3-4186-48b9-82d1-b922e860ffb2 req-c56747d1-8350-40a7-afb2-925050c8620d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:07.807673 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-bf8371a3-4186-48b9-82d1-b922e860ffb2 req-c56747d1-8350-40a7-afb2-925050c8620d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:07.824203 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-bf8371a3-4186-48b9-82d1-b922e860ffb2 req-c56747d1-8350-40a7-afb2-925050c8620d service nova] Creating event network-vif-plugged:93652ce2-3bd3-4207-96bf-3c25e56c5c28 for instance 95199f41-0774-4f39-912e-97a924ef09eb on hv-cinder-85501 Sep 23 15:24:07.830925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-bf8371a3-4186-48b9-82d1-b922e860ffb2 req-c56747d1-8350-40a7-afb2-925050c8620d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101337 Sep 23 15:24:07.831468 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 306/642] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:08.283473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:08.284077 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:08.290612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:08.291091 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:08.291563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:08.292280 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:08.292761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:08.293181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:08.430731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:08.440328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:08.441776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:08.442942 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-26b0d923-449a-469f-a93b-07663edf3b49 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.163764 Sep 23 15:24:08.444168 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 337/643] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:08 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:09.472811 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:09.473892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:09.480024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:09.480516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:09.480985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:09.481693 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:09.482158 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:09.482576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:09.615728 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:09.625070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:09.626624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:09.627922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7af084ba-b3f8-4aeb-af31-8423bb751577 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.161577 Sep 23 15:24:09.628486 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 307/644] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:09 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:10.657023 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:10.657882 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:10.669494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:10.670298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:10.671020 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:10.672160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:10.672987 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:10.673771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:10.826430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:10.837236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:10.838864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:10.840035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d6314d5a-dca2-43dd-8e80-9c1866d733f6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1808 microversion: 2.20 time: 0.189927 Sep 23 15:24:10.851072 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 338/645] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:10 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:11.867946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:11.869101 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:11.877167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:11.877786 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:11.878228 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:11.878902 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:11.879596 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:11.880244 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:12.029526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:12.038543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:12.039983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:12.041185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c86effd5-d05c-4f7b-bc58-4b778119156f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1795 microversion: 2.20 time: 0.177271 Sep 23 15:24:12.041746 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 308/646] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:24:11 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1795 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:24:13.858866 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:13.861205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:13.868141 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:13.869036 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:13.869473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:13.870161 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:13.870615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:13.871042 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:13.894445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'flavor' on Instance uuid d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:14.026931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5fe5c002-4c82-4181-bb9a-cbe54b305104 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/action" status: 200 len: 32 microversion: 2.1 time: 0.171811 Sep 23 15:24:14.027687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 339/647] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:13 2022] POST /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:24:14.037913 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:14.038483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:14.045280 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:14.045793 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:14.046251 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:14.047022 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:14.047478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:14.047915 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:14.256486 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:14.265843 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c09a63fc-60d1-486f-b2ab-2918f42a9ada tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.232158 Sep 23 15:24:14.266433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 309/648] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:14 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:15.296406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:15.297591 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:15.305399 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.305878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.306310 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.306993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:15.307437 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:15.307854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:15.451766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:15.464206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-79e38e47-5074-499b-95fc-c46fda8a809e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.175502 Sep 23 15:24:15.465084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 340/649] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:15 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:16.493781 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:16.494485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:16.503152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:16.504082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:16.505004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:16.505842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:16.506398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:16.506924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:16.649904 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:16.658947 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ea662c2e-36c1-4fcd-8a74-d2a6d9e240ba tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.171047 Sep 23 15:24:16.659635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 310/650] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:16 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:17.688394 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:17.689450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:17.697836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:17.698320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:17.698717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.699473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:17.699926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:17.700349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:17.844351 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:17.853249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8c23a6b4-8742-4bfa-8e8e-eee4f7f77efc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.172225 Sep 23 15:24:17.853819 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 341/651] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:17 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:18.881335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:18.882400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:18.893257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.894059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.894776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:18.895928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:18.896552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:18.897009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:19.039545 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:19.049208 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-09f2b8c7-b11b-40e2-a4a9-6ebe50508daf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.174508 Sep 23 15:24:19.049778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 311/652] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:18 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:20.077625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:20.078597 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:20.089605 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.090381 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.091137 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.092288 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:20.093090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:20.093804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:20.241319 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:20.243989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:20.251280 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-eff90a91-39b1-49aa-9087-5d6af8f13a8f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.180385 Sep 23 15:24:20.251852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 342/653] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:20 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:21.275580 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:21.276909 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:21.284167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.284645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.285088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.285772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:21.286218 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:21.286634 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:21.427513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:21.440073 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-328a8355-3bbc-4660-8d68-7492ace09780 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.168460 Sep 23 15:24:21.440885 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 312/654] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:21 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:22.465370 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:22.466118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:22.476566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:22.477277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:22.477893 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:22.478870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:22.479500 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:22.480114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:22.626018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:22.639067 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8863bbea-6e9a-441a-86df-796e8f1c6ce8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.178691 Sep 23 15:24:22.639825 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 343/655] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:22 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:23.677936 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:23.678774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:23.689838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:23.690646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:23.691373 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:23.692524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:23.693337 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:23.694018 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:23.832577 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:23.845289 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-540ec7c5-c2bf-44b4-b895-92175761bb99 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.173687 Sep 23 15:24:23.846098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 313/656] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:23 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:24.873431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:24.874401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:24.884916 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.885722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.886452 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:24.887595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:24.888350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:24.889102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:25.027948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:25.036747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-33d54579-601f-4bbc-a9f3-73c215acb976 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.170275 Sep 23 15:24:25.037315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 344/657] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:24 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:25.609147 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:25.612977 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:25.621499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:25.621985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:25.622423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:25.623118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:25.623573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:25.623999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:25.701119 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7391fc93-5aac-4f7b-9e5a-55166639934c tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "POST /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.098419 Sep 23 15:24:25.702430 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 314/658] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:25 2022] POST /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:25.709907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:25.710935 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:25.717061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:25.717549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:25.717986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:25.718699 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:25.719139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:25.719556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:25.870853 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:25.879700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-32090edb-93b6-4c3e-bb43-19f0f0cad2d5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1754 microversion: 2.1 time: 0.173725 Sep 23 15:24:25.895883 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 345/659] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:25 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:26.061378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:26.062068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:26.068632 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:26.069486 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:26.069774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:26.070476 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:26.070899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:26.071326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:26.316093 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:26.327370 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-102b5db3-4c5d-454c-b7ea-dcaa2c8f8d45 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.270319 Sep 23 15:24:26.327938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 315/660] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:26 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:26.907741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:26.908822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:26.920087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:26.920958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:26.921680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:26.922830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:26.923585 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:26.924297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:27.077073 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:27.088313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-25771dd6-280d-4c84-a185-3ffff5da2598 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.187238 Sep 23 15:24:27.088915 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 346/661] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:26 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:27.355120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:27.356051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:27.364808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:27.365429 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:27.366012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:27.366944 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:27.367534 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:27.368094 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:27.517129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:27.531233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cc08add8-5a2b-40aa-8eb0-f64333123531 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.182012 Sep 23 15:24:27.532130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 316/662] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:27 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:28.116205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:28.117360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:28.128780 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:28.129561 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:28.130361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:28.131505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:28.132226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:28.132859 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:28.291778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:28.300447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-79a5b281-b529-4fbf-9e5e-55640b7dbab5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.190870 Sep 23 15:24:28.301059 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 347/663] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:28 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:28.557876 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:28.558484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:28.565630 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:28.566124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:28.566562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:28.567274 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:28.567725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:28.568147 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:28.720493 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:28.729300 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-be50b27b-09b4-4ad5-85d3-4779aebf90fb tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.176359 Sep 23 15:24:28.729877 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 317/664] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:28 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:29.335121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:29.335975 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:29.342835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:29.343313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:29.343735 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:29.344420 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:29.344898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:29.345310 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:29.499308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:29.510268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8142fe30-aa11-4d22-918b-ff97de296f99 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.181755 Sep 23 15:24:29.510826 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 348/665] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:29 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:29.757743 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:29.758573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:29.764992 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:29.765480 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:29.765917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:29.766609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:29.767059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:29.767511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:29.911670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:29.920319 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-13c4ddf2-61d6-40e1-923a-568767fe33bf tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.169663 Sep 23 15:24:29.920932 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 318/666] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:29 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:30.538515 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:30.539660 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:30.546596 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:30.547607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:30.547607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:30.548184 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:30.548626 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:30.549080 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:30.703308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:30.714583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8198f80c-20d8-406e-b20b-dced766a5dfa tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.182236 Sep 23 15:24:30.715147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 349/667] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:30 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:30.946208 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:30.946823 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:30.953937 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:30.954355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:30.954790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:30.955479 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:30.955924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:30.956347 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:31.090870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:31.099224 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9fa7435f-7a63-4d56-a019-50384b337b8e tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.158371 Sep 23 15:24:31.099763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 319/668] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:30 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:31.741228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:31.741855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:31.751916 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:31.752540 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:31.753174 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:31.754138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:31.754795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:31.755376 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:31.924738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:31.937977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2dfb680b-99d2-4d8b-ace8-90fd25a8b59a tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.202744 Sep 23 15:24:31.938616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 350/669] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:31 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:32.135614 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:32.136522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:32.147695 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:32.148478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:32.149124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:32.150025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:32.150505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:32.150928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:32.291182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:32.303940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-10ebe5cb-e0f2-4cbc-8d7b-5a561827e7a9 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.174846 Sep 23 15:24:32.304730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 320/670] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:32 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:32.965169 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:32.965926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:32.974970 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:32.975604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:32.976180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:32.977340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:32.977945 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:32.978508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:33.138427 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:33.150393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-dba9a2f4-1d64-45e6-9d08-acd6baeaf0c5 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.191380 Sep 23 15:24:33.150963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 351/671] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:32 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:33.331955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:33.332993 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:33.344430 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:33.345281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:33.346014 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:33.347221 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:33.348049 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:33.348786 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:33.481725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:33.490198 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ae9d1e1f-1cff-40d0-a9e7-7428118637d1 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.164729 Sep 23 15:24:33.490739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 321/672] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:33 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:34.178240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:34.179188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:34.189992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:34.190778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:34.191482 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:34.192637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:34.193414 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:34.194106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:34.348785 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:34.363275 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b5eabe2a-14a1-4250-8412-abce21be6bac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.191339 Sep 23 15:24:34.364293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 352/673] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:34 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:34.516416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:34.517081 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:34.525513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:34.525996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:34.526428 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:34.527115 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:34.527562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:34.527981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:34.530656 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:34.663935 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:34.672474 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-70d16c17-6cd0-4b1b-9207-8d67444641ec tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.161092 Sep 23 15:24:34.673073 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 322/674] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:34 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:35.391680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:35.392753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:35.402139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:35.402628 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:35.403061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:35.403762 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:35.404217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:35.404671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:35.558255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:35.566874 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a241ee34-d047-4bc3-973f-df5c87d856c7 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.181711 Sep 23 15:24:35.567440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 353/675] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:35 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:35.703763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:35.704490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:35.715577 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:35.716204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:35.716915 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:35.717969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:35.718650 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:35.719273 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:35.854212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:35.863290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9e1dea5b-55c0-4142-b2d0-729e87e4ca8d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.167206 Sep 23 15:24:35.863870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 323/676] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:35 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:36.591931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:36.592413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:36.599433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.599913 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.600343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.601069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.601520 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.601944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.750858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:36.763818 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-73f50ca2-da45-4bb7-bcb5-09a79aeeda01 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.176104 Sep 23 15:24:36.764547 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 354/677] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:36 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:36.891587 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:36.892436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:36.895998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=38 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:36.903514 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.903991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.904414 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:36.905126 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:36.905569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:36.905986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:37.042847 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:37.051309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-86e002e2-c53c-4a87-b38a-c007d105128d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.166782 Sep 23 15:24:37.051870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 324/678] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:36 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:37.787046 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:37.787631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:37.790044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=38 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:37.795654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:37.796171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:37.796626 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:37.797328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:37.797782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:37.798197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:37.947008 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:37.955834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-62da3472-64ff-4069-a6fc-f1dd511e32be tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.172809 Sep 23 15:24:37.956407 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 355/679] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:37 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:38.042996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:38.043796 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:38.054455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.055206 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.055963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.057256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.057838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.058229 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.077518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:38.078126 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:38.084343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.084861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.085280 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.085986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.086442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.086872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.183745 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lazy-loading 'services' on Instance uuid b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:38.221403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:38.230578 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1472af20-de86-4eb8-8dcc-5a129c4b1f16 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.157591 Sep 23 15:24:38.231157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 356/680] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:38 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:38.301080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d4c15c43-0924-4548-a6be-740722d1fe7c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/os-volume_attachments/ac783224-f752-4016-b720-b2618fdca344" status: 202 len: 0 microversion: 2.1 time: 0.264547 Sep 23 15:24:38.301573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 325/681] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:24:38 2022] DELETE /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/os-volume_attachments/ac783224-f752-4016-b720-b2618fdca344 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:38.983772 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:38.984723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:38.995670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.996151 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.996616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:38.997324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:38.997781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:38.998205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:39.156665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:39.168833 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1fcbd533-7574-4ea1-bc26-b16a75d05a77 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.191929 Sep 23 15:24:39.169404 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 357/682] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:38 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:39.261737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:39.262326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:39.269865 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:39.270460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:39.270917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:39.271724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:39.272180 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:39.272678 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:39.404903 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:39.413410 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d77e4bb3-7ae8-4688-aa6b-102b2155e772 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1735 microversion: 2.1 time: 0.161734 Sep 23 15:24:39.413981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 326/683] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:39 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:39.898241 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:39.898759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:39.904731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:39.905209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:39.905634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:39.906288 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:39.906730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:39.907177 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:39.929667 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lazy-loading 'flavor' on Instance uuid 9a0a3e47-96a7-461b-81dc-e879cf1df317 {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:24:39.958177 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:40.010368 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1ac7dac2-3d74-4077-bb24-f5b6ed4ab4a2 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "POST /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317/action" status: 202 len: 0 microversion: 2.1 time: 0.115936 Sep 23 15:24:40.014550 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 358/684] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:39 2022] POST /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:40.020539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:40.021110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.028520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.029121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.029555 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.030410 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.030910 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.031358 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.191167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:40.194463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:40.195157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.199688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ac6157cd-7b6f-48bc-bdc9-2f3b06eceb70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.183404 Sep 23 15:24:40.200739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 327/685] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:40 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:40.202128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.202620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.203054 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.203760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.204215 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.204705 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.358808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:40.368658 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-dec57635-97d4-47b4-a558-58ff044344fb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.178432 Sep 23 15:24:40.369576 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 359/686] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:40 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:40.438012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:40.438549 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.445555 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.446007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.446445 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.447147 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.447723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.448471 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.497875 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8e83f7ba-403a-48dd-89e0-9d036fdce610 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:40.504425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e83f7ba-403a-48dd-89e0-9d036fdce610 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.504965 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e83f7ba-403a-48dd-89e0-9d036fdce610 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.505399 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e83f7ba-403a-48dd-89e0-9d036fdce610 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.573158 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8e83f7ba-403a-48dd-89e0-9d036fdce610 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Going to try to stop instance {{(pid=120918) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 15:24:40.599221 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:40.608602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7387862b-ce02-49f2-b8bb-0bcb104d69c8 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1715 microversion: 2.1 time: 0.174547 Sep 23 15:24:40.609208 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 328/687] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:40 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:40.635083 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8e83f7ba-403a-48dd-89e0-9d036fdce610 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.142389 Sep 23 15:24:40.636752 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 360/688] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:40 2022] POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:40.644207 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:40.645527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.650879 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.651423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.652006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.652967 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.653514 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.654000 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.682156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:40.683059 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.693140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.693904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.694599 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.695828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.696478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.697159 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.803216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:40.811800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bde8a8e3-985a-43da-8072-7e371d5ce8b4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.171528 Sep 23 15:24:40.812574 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 329/689] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:40 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:40.831287 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] HTTP exception thrown: Cannot 'detach_volume' instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 while it is in vm_state rescued Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Request method failure captured: Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: DELETE /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments/32163891-7e70-4867-9af1-2022afa8c03e HTTP/1.1 Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4v9pxEJ1GpUW2lHlRNm3QpF5nvIevVMf9lP9v--RxSo7eSx4YJ-Deu_hBvtd-nl2xQdH0M6DPTGxOeQ1bepbh069Zba1lVXk6rl9ZJG1TZcCvKiBttYubPPwOANtZ3iLeWQ1YPshCdqdA3vVdRIIucD8Z-7bzSBbWjWZtTATOH78c Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:24:40.832922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1abe4f1508864f77b30c4c635c368f02"}]}] Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4cfac62e1c304167abb971815d5da358 Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:24:40.834491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Cannot 'detach_volume' instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 while it is in vm_state rescued Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'server_id': 'd1b9e193-5eb8-4876-ba58-a8e1ccf5ea25', 'id': '32163891-7e70-4867-9af1-2022afa8c03e'} Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:24:40.835315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 while it is in vm_state rescued Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 while it is in vm_state rescued Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:24:40.836657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Returning 409 to user: Cannot 'detach_volume' instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 while it is in vm_state rescued {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:24:40.837616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b9f8dee0-0870-4635-ab17-95974caa2360 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments/32163891-7e70-4867-9af1-2022afa8c03e" status: 409 len: 152 microversion: 2.1 time: 0.160754 Sep 23 15:24:40.837616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 361/690] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:24:40 2022] DELETE /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments/32163891-7e70-4867-9af1-2022afa8c03e => generated 152 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 15:24:40.843688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:40.844218 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.850223 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.850702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.851135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.851821 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.857282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.858191 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.928135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-aacea0a7-0598-4c02-a384-7f9738b0c4a6 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "POST /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/action" status: 202 len: 0 microversion: 2.1 time: 0.088445 Sep 23 15:24:40.929165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 330/691] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:40 2022] POST /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:40.937831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:40.938435 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:40.946221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.946963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.947578 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:40.948552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:40.949042 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:40.949625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:41.082653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:41.093148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0e1e1db5-43ea-411e-8af2-acffcc8afb7b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1723 microversion: 2.1 time: 0.159548 Sep 23 15:24:41.093716 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 362/692] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:40 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:41.224165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:41.224884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:41.231322 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:41.231820 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:41.232259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:41.232996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:41.233452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:41.233878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:41.392111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:41.392828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:41.399047 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:41.399533 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:41.399968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:41.400703 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:41.401157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:41.401566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:41.429532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:41.438088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1e26a984-c586-4171-a5f2-1b3bd16981b1 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.218784 Sep 23 15:24:41.438785 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 331/693] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:41 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:41.547330 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:41.556538 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4fcd6f15-901e-454f-aa1c-edf0cba200a8 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.168368 Sep 23 15:24:41.557466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 363/694] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:41 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:41.840930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:41.841573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:41.848409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:41.848930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:41.849371 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:41.850067 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:41.850546 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:41.850958 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.010587 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:42.023655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-25f0a8d7-bed0-47b1-9011-462500a2ebd3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.188963 Sep 23 15:24:42.024557 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 332/695] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:41 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:42.120929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:42.122337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:42.133243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.134023 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.134743 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.135883 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.136652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.138009 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.285064 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:42.295322 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d43dc051-ddd4-4d18-b043-a1b2dad3a8fc tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1723 microversion: 2.1 time: 0.181267 Sep 23 15:24:42.295864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 364/696] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:42 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:42.465406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:42.466017 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:42.472538 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.473060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.473501 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.474191 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.474644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.475070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.590587 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:42.590874 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:42.597586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.598068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.598531 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.599222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:42.599672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:42.600090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:42.607535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:42.615648 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3639d1b8-6b62-44e4-b0da-47c738fcdfee tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.156062 Sep 23 15:24:42.616223 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 333/697] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:42 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:42.754613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:42.767781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-994ff291-fddf-4179-8091-dc8979763306 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.181275 Sep 23 15:24:42.768732 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 365/698] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:42 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:43.053114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:43.053990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:43.065118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.065920 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.066643 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.067793 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.068622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.069355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.208327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:43.218639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3764b4a8-6b17-4ce5-893f-270a0e0aaf97 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.172247 Sep 23 15:24:43.219174 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 334/699] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:43 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:43.322750 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:43.323753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:43.335344 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.336149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.336948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.338096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.338855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.339560 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.487523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:43.496809 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c5f08c8a-f10d-4699-acb4-93cd65f96e34 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1723 microversion: 2.1 time: 0.180607 Sep 23 15:24:43.497364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 366/700] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:43 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:43.640670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:43.641214 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:43.647825 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.648308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.648767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.649450 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.649896 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.650310 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.785511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:43.793860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-844c3136-d283-4f2e-a12e-8575cb4b82c3 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.157676 Sep 23 15:24:43.794444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 335/701] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:43 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:43.794908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:43.795520 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:43.801614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.802129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.802586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.803318 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:43.803774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:43.804195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:43.947599 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:43.956994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-dd263079-58ca-4a67-8044-265f169bb1e1 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1759 microversion: 2.1 time: 0.165924 Sep 23 15:24:43.957556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 367/702] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:43 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:44.248707 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:44.249268 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:44.256341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.256859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.257301 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.258004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.258451 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.258872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.398376 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:44.406763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8797a776-b874-49d2-a007-9ffccadb09e4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.164458 Sep 23 15:24:44.407336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 336/703] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:44 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:44.531774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:44.532496 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:44.542468 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.543421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.543763 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.544457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.544929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.545347 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.683246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:44.691858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-aa154603-f263-4a43-9a1c-f2bdf6d9722a tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1723 microversion: 2.1 time: 0.166075 Sep 23 15:24:44.692468 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 368/704] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:44 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:44.823563 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:44.824955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:44.835523 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.836323 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.837091 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.838230 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.838934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.839671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.843100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:44.978823 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:44.979495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:44.980120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:44.986314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.986798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.986912 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d9a22bc5-19ba-4671-b08c-f6b9b3881f70 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.171405 Sep 23 15:24:44.987228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:44.987502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 337/705] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:44 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:44.987922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:44.988377 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:44.988842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.135030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:45.144880 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a27dd4c1-c855-404c-a4bf-0e2459c99a43 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1762 microversion: 2.1 time: 0.169288 Sep 23 15:24:45.145518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 369/706] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:44 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1762 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:45.435055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:45.436022 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:45.447435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:45.448233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:45.449022 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.450326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:45.450812 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:45.451247 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.586586 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:45.595958 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-08a8713c-b784-4d8c-a857-6defd2b4f28c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.168202 Sep 23 15:24:45.596712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 338/707] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:45 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:45.717922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:45.718494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:45.725957 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:45.726477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:45.726972 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.727715 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:45.728206 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:45.728719 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.865967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:45.875017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2316ff5f-6261-4861-a55a-bb01282b1648 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1729 microversion: 2.1 time: 0.162426 Sep 23 15:24:45.875596 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 370/708] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:45 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:45.901912 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:45.902536 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:45.908884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:45.909364 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:45.909783 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.910458 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:45.910903 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:45.911315 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:45.996651 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-736abfdd-1bfb-4df3-acf4-29417dafa594 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098120 Sep 23 15:24:45.997447 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 339/709] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Sep 23 15:24:45 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:46.013954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:46.014553 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:46.020852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:46.021332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:46.021763 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:46.022453 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:46.022903 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:46.023329 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:46.163828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:46.172114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a504308b-b6e9-4430-bb3b-0f9c336a6bab tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.162052 Sep 23 15:24:46.172714 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 371/710] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:46 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:46.620498 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:46.621184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:46.628646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:46.629178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:46.629611 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:46.630319 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:46.630771 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:46.631196 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:46.907918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:46.918011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ed528423-8313-4778-96f1-27a6bb8f856f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.300828 Sep 23 15:24:46.918011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 340/711] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:46 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:47.195034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:47.195929 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:47.205152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:47.205675 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:47.206107 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:47.206812 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:47.207292 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:47.207712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:47.254457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-12fc8a4a-efa5-4045-89f5-468907f5e9b8 req-130b5f83-7d9a-4323-be0f-d870390f024c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25", "tag": "306b9553-4640-49fe-82dd-dd744475cdb3"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:47.264629 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-12fc8a4a-efa5-4045-89f5-468907f5e9b8 req-130b5f83-7d9a-4323-be0f-d870390f024c service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:47.265557 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-12fc8a4a-efa5-4045-89f5-468907f5e9b8 req-130b5f83-7d9a-4323-be0f-d870390f024c service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:47.267527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-12fc8a4a-efa5-4045-89f5-468907f5e9b8 req-130b5f83-7d9a-4323-be0f-d870390f024c service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:47.277869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-12fc8a4a-efa5-4045-89f5-468907f5e9b8 req-130b5f83-7d9a-4323-be0f-d870390f024c service nova] Creating event network-changed:306b9553-4640-49fe-82dd-dd744475cdb3 for instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 on hv-cinder-85501 Sep 23 15:24:47.283215 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-12fc8a4a-efa5-4045-89f5-468907f5e9b8 req-130b5f83-7d9a-4323-be0f-d870390f024c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111288 Sep 23 15:24:47.283812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 372/712] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:24:47.352282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:47.361534 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dbf86b1a-1ed3-4d69-b875-0f8b0ef0f4a6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.170290 Sep 23 15:24:47.369955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 341/713] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:47 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:24:47.941006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:47.941696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:47.948211 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:47.948745 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:47.949183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:47.949928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:47.950356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:47.950812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:48.084286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:48.086678 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:48.093932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7a656c75-c5f0-45e0-8ff7-fac69bebfe78 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.157321 Sep 23 15:24:48.094509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 373/714] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:47 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:48.388198 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:48.388788 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:48.395653 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:48.396136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:48.396550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:48.397306 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:48.397758 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:48.398177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:48.536124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:48.544681 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a804937e-e0da-40d1-bed4-81d0743fc36f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.162736 Sep 23 15:24:48.545230 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 342/715] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:48 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:49.123255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:49.124190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:49.136983 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:49.137754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:49.138483 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:49.139604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:49.140054 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:49.140469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:49.279459 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:49.297257 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c8e06ccb-46d3-4069-b77e-8e714878f0d0 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.182708 Sep 23 15:24:49.300648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 374/716] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:49 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:49.301366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-d3b509db-77cc-4b26-a7ea-a12429655666 req-3ec2b8f2-eb0b-4551-a5d0-b1789e89125f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25", "tag": "306b9553-4640-49fe-82dd-dd744475cdb3"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:49.311086 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d3b509db-77cc-4b26-a7ea-a12429655666 req-3ec2b8f2-eb0b-4551-a5d0-b1789e89125f service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:49.311535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d3b509db-77cc-4b26-a7ea-a12429655666 req-3ec2b8f2-eb0b-4551-a5d0-b1789e89125f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:49.311961 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d3b509db-77cc-4b26-a7ea-a12429655666 req-3ec2b8f2-eb0b-4551-a5d0-b1789e89125f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:49.323398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-d3b509db-77cc-4b26-a7ea-a12429655666 req-3ec2b8f2-eb0b-4551-a5d0-b1789e89125f service nova] Creating event network-changed:306b9553-4640-49fe-82dd-dd744475cdb3 for instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 on hv-cinder-85501 Sep 23 15:24:49.328411 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-d3b509db-77cc-4b26-a7ea-a12429655666 req-3ec2b8f2-eb0b-4551-a5d0-b1789e89125f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031060 Sep 23 15:24:49.329038 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 343/717] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:24:49.569939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:49.570759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:49.577470 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:49.577994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:49.578522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:49.579282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:49.579793 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:49.580274 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:49.713071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:49.721315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a64763b1-1c63-40b8-a823-0bd16cec441f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.156055 Sep 23 15:24:49.722028 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 375/718] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:49 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:50.323155 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:50.323948 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:50.330972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:50.331456 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:50.331879 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:50.332553 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:50.333035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:50.333457 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:50.553125 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:50.561442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-735c1252-0463-4dc4-bc4c-69aae78ea7cb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1676 microversion: 2.1 time: 0.243037 Sep 23 15:24:50.562020 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 344/719] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:50 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:50.745316 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:50.745912 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:50.752945 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:50.753422 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:50.753850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:50.754516 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:50.754999 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:50.755418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:50.890693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:50.898492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1b5e279c-5c0a-4923-89c3-9ad5e3b054cb tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.157482 Sep 23 15:24:50.899031 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 376/720] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:50 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:51.588415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:51.589431 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:51.597502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.597985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.598418 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.599107 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.599554 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.599974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.737422 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:51.749433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8c8053ca-4159-467c-8879-39f133fcf4f7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1653 microversion: 2.1 time: 0.167386 Sep 23 15:24:51.750041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 345/721] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:51 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1653 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:51.772424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-19cf2bb9-1842-410c-a3b3-f8cd3e13fbbb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:51.779657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19cf2bb9-1842-410c-a3b3-f8cd3e13fbbb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.780145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19cf2bb9-1842-410c-a3b3-f8cd3e13fbbb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.780582 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19cf2bb9-1842-410c-a3b3-f8cd3e13fbbb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.803285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-19cf2bb9-1842-410c-a3b3-f8cd3e13fbbb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Going to try to start instance {{(pid=120918) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 15:24:51.854210 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-19cf2bb9-1842-410c-a3b3-f8cd3e13fbbb tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.085013 Sep 23 15:24:51.855078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 377/722] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:51 2022] POST /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:51.864092 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:51.864837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:51.871702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.872195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.872662 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.873406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.873862 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.874291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.923016 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:51.923694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:51.929993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.930480 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.930911 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:51.931606 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:51.932050 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:51.932472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:52.011508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:52.020118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9313cdc6-4914-45e2-934a-883d87b001de tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1662 microversion: 2.1 time: 0.159935 Sep 23 15:24:52.020713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 346/723] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:51 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:52.075682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:52.084010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e3fe62fd-da74-4609-8b70-cd799eddf58b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.165404 Sep 23 15:24:52.084583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 378/724] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:51 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:53.045471 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:53.046181 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:53.052960 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:53.053448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:53.053884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:53.054588 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:53.055038 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:53.055459 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:53.117568 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:53.118432 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:53.128015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:53.129830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:53.129991 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:53.130741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:53.131289 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:53.131757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:53.265016 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:53.274380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-421bc81a-3bb8-46b6-9bed-7722344da60b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1662 microversion: 2.1 time: 0.232768 Sep 23 15:24:53.290360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:53.291693 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 347/725] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:53 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1662 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:53.300025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-99dabf0e-2287-475a-9640-c3f1b0efd6c6 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.187105 Sep 23 15:24:53.305212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 379/726] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:53 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:54.300260 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:54.300863 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:54.308070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.308548 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.309019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.309706 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.310155 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.310572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.325013 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:54.325610 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:54.332834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.333327 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.333761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.334469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.334900 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.335357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.446614 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:54.455448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d3f729b0-61fb-4abd-89f3-7b7e581e0c7a tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1666 microversion: 2.1 time: 0.159356 Sep 23 15:24:54.456119 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 348/727] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:54 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:54.473007 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:54.480871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-52f059af-d957-4616-bac3-fe0332d1ab8c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1507 microversion: 2.1 time: 0.159748 Sep 23 15:24:54.481418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 380/728] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:54 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:54.505321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:54.505917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:54.511839 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.512321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.512795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.513483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.513934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.514356 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.607921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120919) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 15:24:54.680520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-86710e55-5cdf-4c96-bac2-26e8d5513aff tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "POST /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317/action" status: 202 len: 0 microversion: 2.1 time: 0.179097 Sep 23 15:24:54.681195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 349/729] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:24:54 2022] POST /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:24:54.689729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:54.690321 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:54.696636 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.697146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.697572 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.698248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:54.698693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:54.699101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:54.834690 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:54.842470 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2a739fd8-f0c7-488a-b59c-753634b1a320 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1515 microversion: 2.1 time: 0.156856 Sep 23 15:24:54.843231 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 381/730] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:54 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:55.867216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:55.867835 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:55.877731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:55.878414 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:55.879032 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:55.879866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:55.880562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:55.881194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:55.920853 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-5da86c99-6046-4b55-8754-1f9193cfa7d6 req-6db51cdb-bb43-4da4-b158-ed3b29865080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0a3e47-96a7-461b-81dc-e879cf1df317", "name": "network-vif-unplugged", "status": "completed", "tag": "aa222fb4-42c6-4891-beb9-013184d89cc9"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:24:55.931264 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5da86c99-6046-4b55-8754-1f9193cfa7d6 req-6db51cdb-bb43-4da4-b158-ed3b29865080 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:55.931750 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5da86c99-6046-4b55-8754-1f9193cfa7d6 req-6db51cdb-bb43-4da4-b158-ed3b29865080 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:55.932166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5da86c99-6046-4b55-8754-1f9193cfa7d6 req-6db51cdb-bb43-4da4-b158-ed3b29865080 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:55.944638 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.compute.server_external_events [req-5da86c99-6046-4b55-8754-1f9193cfa7d6 req-6db51cdb-bb43-4da4-b158-ed3b29865080 service nova] Unable to find a host for instance 9a0a3e47-96a7-461b-81dc-e879cf1df317. Dropping event network-vif-unplugged {{(pid=120918) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 15:24:55.945842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-5da86c99-6046-4b55-8754-1f9193cfa7d6 req-6db51cdb-bb43-4da4-b158-ed3b29865080 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028854 Sep 23 15:24:55.946698 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 382/731] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 15:24:56.026046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:56.034072 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-527b2c4a-ca5c-4277-b2cc-403e04c4ed66 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1517 microversion: 2.1 time: 0.172005 Sep 23 15:24:56.034642 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 350/732] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:55 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:57.061307 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:57.062910 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:57.073877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:57.074683 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:57.075405 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:57.076550 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:57.077434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:57.077855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:57.213461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:57.221494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-73cc797f-1c2c-44dd-9c90-81a9ca02f14a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.166877 Sep 23 15:24:57.222072 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 383/733] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:57 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:58.247026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:58.247889 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:58.250882 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:24:58.251088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Fri Sep 23 15:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 (ip 10.222.0.75) !!! Sep 23 15:24:58.258634 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:58.259133 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:58.259566 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:58.260270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:58.260760 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:58.261188 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:58.401858 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:58.409917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1353d3bc-ed65-497a-994f-87dc98333747 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.167629 Sep 23 15:24:58.410490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 351/734] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:58 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:24:59.437513 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:24:59.438499 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:24:59.449841 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:59.450641 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:59.451355 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:59.452499 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:24:59.453300 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:24:59.454003 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:24:59.586023 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:24:59.595148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b108c4bf-cdb4-4342-b72d-2390f7d97de0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.164039 Sep 23 15:24:59.595827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 384/735] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:24:59 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:00.623354 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:00.624418 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:00.632244 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:00.632764 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:00.633206 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:00.633899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:00.634377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:00.634783 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:00.769109 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:00.777216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-834dfa22-bc65-4e49-b2ed-4a6bb56060cc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.160823 Sep 23 15:25:00.777760 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 352/736] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:00 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:01.804761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:01.805472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:01.815453 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:01.816096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:01.816718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:01.817635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:01.818240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:01.818781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:01.963225 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:01.971922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2458004d-1786-4935-b66d-1f83c4d055e0 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.173317 Sep 23 15:25:01.972490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 385/737] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:01 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:02.999928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:03.000976 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:03.011836 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:03.012667 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:03.013422 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:03.014639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:03.015291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:03.015983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:03.163205 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:03.166424 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:03.175039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8d1eeb27-55bc-44b5-b1eb-152e7fc157bc tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.182059 Sep 23 15:25:03.175647 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 353/738] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:02 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:04.202268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:04.204251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:04.215592 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:04.216374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:04.217140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:04.218275 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:04.219027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:04.219717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:04.363084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:04.371848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-52a816e0-0067-40dc-bc5f-91d72ec6932f tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.176262 Sep 23 15:25:04.372424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 386/739] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:04 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:05.395918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:05.396494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:05.404351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:05.404864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:05.405326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:05.406011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:05.406459 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:05.406871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:05.590603 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:05.600908 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-31416f19-5932-4b56-858d-a89cb1ae12ba tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.209369 Sep 23 15:25:05.601502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 354/740] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:05 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:06.624569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:06.625240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:06.631879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:06.632375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:06.632846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:06.633551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:06.634013 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:06.634436 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:06.768168 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:06.775924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-48edb8ef-11f5-478b-8479-3f486ede9b8b tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.155515 Sep 23 15:25:06.776498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 387/741] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:06 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:07.800676 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:07.801248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:07.803750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:07.809452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:07.809928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:07.810352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:07.811031 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:07.811460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:07.811867 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:07.955170 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:07.963798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c9ca30b1-7374-4478-b164-856ac8cf5164 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.167221 Sep 23 15:25:07.964562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 355/742] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:07 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:08.146094 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-999d4dc1-385e-4eb9-a42b-81addeb2ea3c req-b554c603-6c9b-42d2-96b3-9f939fbf6a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0a3e47-96a7-461b-81dc-e879cf1df317", "name": "network-vif-plugged", "status": "completed", "tag": "aa222fb4-42c6-4891-beb9-013184d89cc9"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:08.152729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=66 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:08.156530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-999d4dc1-385e-4eb9-a42b-81addeb2ea3c req-b554c603-6c9b-42d2-96b3-9f939fbf6a2d service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:08.157041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-999d4dc1-385e-4eb9-a42b-81addeb2ea3c req-b554c603-6c9b-42d2-96b3-9f939fbf6a2d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:08.157466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-999d4dc1-385e-4eb9-a42b-81addeb2ea3c req-b554c603-6c9b-42d2-96b3-9f939fbf6a2d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:08.169283 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-999d4dc1-385e-4eb9-a42b-81addeb2ea3c req-b554c603-6c9b-42d2-96b3-9f939fbf6a2d service nova] Creating event network-vif-plugged:aa222fb4-42c6-4891-beb9-013184d89cc9 for instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 on hv-cinder-85501 Sep 23 15:25:08.174722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-999d4dc1-385e-4eb9-a42b-81addeb2ea3c req-b554c603-6c9b-42d2-96b3-9f939fbf6a2d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Sep 23 15:25:08.175359 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 388/743] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:08.991487 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:08.992166 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:09.000459 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:09.001065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:09.001574 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:09.002390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:09.002924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:09.003427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:09.175727 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:09.184444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-609c3af4-f69e-4939-acc6-6fcbf753a596 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.199264 Sep 23 15:25:09.185139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 356/744] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:08 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:10.213170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:10.213995 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:10.226393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:10.227158 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:10.227881 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:10.228946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:10.229312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:10.229731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:10.378113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:10.388437 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6dda24a0-79ed-43ab-aa1b-a39ab54a7727 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1573 microversion: 2.1 time: 0.183578 Sep 23 15:25:10.389101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 389/745] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:10 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:11.417026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:11.417583 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:11.424383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:11.424980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:11.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:11.426066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:11.426509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:11.426923 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:11.727756 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:11.735931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d55acd7f-6077-4f12-a4a0-058f04f16c1a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1560 microversion: 2.1 time: 0.325523 Sep 23 15:25:11.736513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 357/746] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:11 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1560 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:19.134689 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:19.135317 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:19.142188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.142669 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.143093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.143779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.144225 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.144634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.147102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:19.176294 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3efe85c1-3cb2-4bda-93aa-c11fb69d676a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments/dc7dd7c2-724a-4440-825d-7746ae07f08d" status: 200 len: 194 microversion: 2.20 time: 0.048469 Sep 23 15:25:19.176902 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 390/747] 10.222.0.75 () {60 vars in 1454 bytes} [Fri Sep 23 15:25:19 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments/dc7dd7c2-724a-4440-825d-7746ae07f08d => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:25:19.259502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:19.260039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:19.267363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.267836 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.268256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.268967 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.269408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.270082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.354176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lazy-loading 'services' on Instance uuid 95199f41-0774-4f39-912e-97a924ef09eb {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:19.432464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-00563ab5-3615-4797-ae7e-43d4e4d468ea tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "DELETE /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments/dc7dd7c2-724a-4440-825d-7746ae07f08d" status: 202 len: 0 microversion: 2.20 time: 0.177035 Sep 23 15:25:19.433062 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 358/748] 10.222.0.75 () {60 vars in 1457 bytes} [Fri Sep 23 15:25:19 2022] DELETE /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments/dc7dd7c2-724a-4440-825d-7746ae07f08d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:25:19.442631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:19.444891 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:19.450928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.451454 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.451852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.452636 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:19.453037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:19.453460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:19.484460 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5b14dfa5-734c-4653-be2e-efdf5f2251dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046622 Sep 23 15:25:19.488714 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 391/749] 10.222.0.75 () {60 vars in 1343 bytes} [Fri Sep 23 15:25:19 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 15:25:20.498270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:20.500725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:20.507512 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:20.507997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:20.508429 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.509166 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:20.509691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:20.510121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:20.547188 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f5b3bc0f-efdc-42d5-b8ee-c2d5a55fe8b1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053518 Sep 23 15:25:20.548090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 359/750] 10.222.0.75 () {60 vars in 1343 bytes} [Fri Sep 23 15:25:20 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:25:21.561523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:21.563840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:21.570569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.571062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.571497 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.572193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.572673 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.573104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.602798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fec345e5-5d68-4cd1-806c-848fb4c610b6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046243 Sep 23 15:25:21.603361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 392/751] 10.222.0.75 () {60 vars in 1343 bytes} [Fri Sep 23 15:25:21 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:21.667636 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:21.668281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:21.675431 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.675917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.676356 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.677083 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.677539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.677962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.704064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:25:21.791301 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9d163f70-7218-4165-93c7-c3c2a0656e47 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "DELETE /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 204 len: 0 microversion: 2.20 time: 0.127402 Sep 23 15:25:21.791899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 360/752] 10.222.0.75 () {60 vars in 1280 bytes} [Fri Sep 23 15:25:21 2022] DELETE /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 15:25:21.801083 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:21.801686 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:21.807870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.808920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.809362 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.810088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:21.810540 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:21.810953 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:21.946860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:21.955566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:21.957029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:21.958177 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d9ce807b-293e-484a-981a-9324ebc9865c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.160995 Sep 23 15:25:21.958727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 393/753] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:21 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:22.989244 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:22.990400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:22.999992 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.000485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.000957 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.001653 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:23.002109 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:23.002532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:23.147722 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:23.158124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:23.159553 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:23.160769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-33f93295-0dda-4d1c-a0a4-ab1da76d0311 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.178887 Sep 23 15:25:23.161297 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 361/754] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:22 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:24.187713 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:24.188341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:24.195242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:24.195730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:24.196160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.196903 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:24.197353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:24.197772 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:24.334043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:24.342788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:24.344334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:24.345600 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ded688ae-bb09-4119-ad3a-a2d27d16c3da tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1723 microversion: 2.20 time: 0.162071 Sep 23 15:25:24.346225 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 394/755] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:24 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:25.097026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-63d2220e-0771-403a-b35f-6e8a5d3f846c req-047306aa-bce9-45f6-8d31-6bf1ac260340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95199f41-0774-4f39-912e-97a924ef09eb", "name": "network-vif-deleted", "tag": "93652ce2-3bd3-4207-96bf-3c25e56c5c28"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:25.109643 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-63d2220e-0771-403a-b35f-6e8a5d3f846c req-047306aa-bce9-45f6-8d31-6bf1ac260340 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.113109 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-63d2220e-0771-403a-b35f-6e8a5d3f846c req-047306aa-bce9-45f6-8d31-6bf1ac260340 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.113572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-63d2220e-0771-403a-b35f-6e8a5d3f846c req-047306aa-bce9-45f6-8d31-6bf1ac260340 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:25.127909 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-63d2220e-0771-403a-b35f-6e8a5d3f846c req-047306aa-bce9-45f6-8d31-6bf1ac260340 service nova] Creating event network-vif-deleted:93652ce2-3bd3-4207-96bf-3c25e56c5c28 for instance 95199f41-0774-4f39-912e-97a924ef09eb on hv-cinder-85501 Sep 23 15:25:25.134407 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-63d2220e-0771-403a-b35f-6e8a5d3f846c req-047306aa-bce9-45f6-8d31-6bf1ac260340 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044404 Sep 23 15:25:25.135034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 362/756] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:25.371518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:25.372920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:25.380517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.381155 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.381868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:25.382760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.383552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.384045 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:25.417553 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:25.418035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:25.418473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:25.418984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lazy-loading 'fault' on Instance uuid 95199f41-0774-4f39-912e-97a924ef09eb {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:25.469832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:25.479485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:25.480966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:25.482275 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1dc6b837-b38c-4540-929c-157a98e266bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 200 len: 1371 microversion: 2.20 time: 0.115016 Sep 23 15:25:25.482829 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 395/757] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:25 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:26.509412 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:26.510095 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:26.517311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:26.517790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:26.518222 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:26.518949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:26.519394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:26.519812 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:26.533792 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] HTTP exception thrown: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Request method failure captured: Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb HTTP/1.1 Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc4z3H00xaPzOO6KHqe4EjQi5mq37OzzXTCiLUU5mYKx5msIrkyyM0CG8xhdsm9qrJN6by3yC9NhTEOJt-7SEebjNUn3_T7VlD1sFW1Hi6sdmMgNe4q1ClzVDjPTRR8_C2zLVKZt3afFOL-CZ8xx3l_s-aZli-zrP6Cn72DDqX72oP4 Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:25:26.535473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bb9f84f2d16a4389a4be567cd2be3a8a"}]}] Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: e38b853b47b64567b00092eb32201b4d Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:25:26.536953 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '95199f41-0774-4f39-912e-97a924ef09eb'} Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:25:26.537775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:25:26.539448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:26.540984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Returning 404 to user: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:25:26.540984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b4484b08-9d83-4d9c-8a05-3dcc100e32be tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 404 len: 111 microversion: 2.20 time: 0.032331 Sep 23 15:25:26.540984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 363/758] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:26 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:25:26.546515 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-07eac59b-c464-43cd-95c5-054ec5b6686d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '.version_select at 0x7fbb02f02280>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:26.569125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-07eac59b-c464-43cd-95c5-054ec5b6686d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024836056" status: 204 len: 0 microversion: 2.20 time: 0.026496 Sep 23 15:25:26.569712 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 396/759] 10.222.0.75 () {60 vars in 1262 bytes} [Fri Sep 23 15:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024836056 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 15:25:27.289510 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0ed1a69a-21c0-4fdf-9393-5f716dce25a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'create', calling method: .version_select at 0x7fbb02db9f70>, body: {"keypair": {"name": "tempest-keypair-1355901890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFtl6K0aQZSb8y90mDZy2uAPMExLryRRvXwfPM+592PratQ1e1kPCE78c5jvxAFFeVheDJCAYGlWKjiEAVBYQuh9VGA+rOomkqVpNYkr8NHxux2sp6kSUKbsvLDZrWSMg=="}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:27.307982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-0ed1a69a-21c0-4fdf-9393-5f716dce25a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Getting quotas for project bb9f84f2d16a4389a4be567cd2be3a8a. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:25:27.312420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-0ed1a69a-21c0-4fdf-9393-5f716dce25a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Getting quotas for user e38b853b47b64567b00092eb32201b4d and project bb9f84f2d16a4389a4be567cd2be3a8a. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:25:27.347599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-0ed1a69a-21c0-4fdf-9393-5f716dce25a9 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.063969 Sep 23 15:25:27.348485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 364/760] 10.222.0.75 () {62 vars in 1200 bytes} [Fri Sep 23 15:25:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 15:25:28.924188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-580547264", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16dbf76f-cd6b-4812-a7f7-e2899a0b32a2"}], "security_groups": [{"name": "tempest-securitygroup--1577650949"}], "key_name": "tempest-keypair-1355901890", "user_data": "}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:29.040148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] validate_networks() for [('16dbf76f-cd6b-4812-a7f7-e2899a0b32a2', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:25:29.448999 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:25:29.449420 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:25:29.449892 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:25:29.450295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:25:29.450704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:25:29.460817 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:29.461299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:29.461702 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:29.462435 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:29.462888 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:29.463316 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:29.483632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Getting quotas for project bb9f84f2d16a4389a4be567cd2be3a8a. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:25:29.487822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Getting quotas for user e38b853b47b64567b00092eb32201b4d and project bb9f84f2d16a4389a4be567cd2be3a8a. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:25:29.499925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:25:29.502315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:25:29.557371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-61224f43-689b-447c-a41c-26539cfd423e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.637664 Sep 23 15:25:29.558039 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 397/761] 10.222.0.75 () {62 vars in 1188 bytes} [Fri Sep 23 15:25:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 15:25:29.569844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5f64a522-ac61-4ed1-bc4d-1d6c8c35bb64 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:29.570577 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5f64a522-ac61-4ed1-bc4d-1d6c8c35bb64 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:29.639680 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5f64a522-ac61-4ed1-bc4d-1d6c8c35bb64 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:29.647260 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5f64a522-ac61-4ed1-bc4d-1d6c8c35bb64 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:29.648776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5f64a522-ac61-4ed1-bc4d-1d6c8c35bb64 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:29.649805 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5f64a522-ac61-4ed1-bc4d-1d6c8c35bb64 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1281 microversion: 2.20 time: 0.084075 Sep 23 15:25:29.650352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 365/762] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:29 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:30.681121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:30.682006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:30.690113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.690595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.691028 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.691718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:30.692167 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:30.692619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:30.756022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:30.764497 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:30.766304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:30.767402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2ae5b43d-75ca-460c-94a6-167576912b25 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1333 microversion: 2.20 time: 0.093852 Sep 23 15:25:30.767966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 398/763] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:30 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:31.793654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:31.794260 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:31.800759 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:31.801248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:31.803147 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:31.803867 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:31.804329 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:31.804798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:32.026601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:32.035762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:32.037212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:32.038321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f9085d5d-a9b5-4943-8310-9f3d5148b105 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1407 microversion: 2.20 time: 0.248979 Sep 23 15:25:32.038849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 366/764] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:31 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:32.562514 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-a7bf4837-7a6b-4a72-9eea-c6b26e499e0b req-f02b19f9-5bde-486c-9a86-d8c0d6138254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37411fb8-ca8b-42de-850e-3ca0d9c9d615", "tag": "5ce0bfbd-c402-457c-b397-3abfbebd324a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:32.573227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a7bf4837-7a6b-4a72-9eea-c6b26e499e0b req-f02b19f9-5bde-486c-9a86-d8c0d6138254 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:32.573825 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a7bf4837-7a6b-4a72-9eea-c6b26e499e0b req-f02b19f9-5bde-486c-9a86-d8c0d6138254 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:32.574462 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a7bf4837-7a6b-4a72-9eea-c6b26e499e0b req-f02b19f9-5bde-486c-9a86-d8c0d6138254 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:32.585988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-a7bf4837-7a6b-4a72-9eea-c6b26e499e0b req-f02b19f9-5bde-486c-9a86-d8c0d6138254 service nova] Creating event network-changed:5ce0bfbd-c402-457c-b397-3abfbebd324a for instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 on hv-cinder-85501 Sep 23 15:25:32.591014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-a7bf4837-7a6b-4a72-9eea-c6b26e499e0b req-f02b19f9-5bde-486c-9a86-d8c0d6138254 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032207 Sep 23 15:25:32.591595 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 399/765] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:25:33.063714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:33.064498 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:33.071701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:33.072203 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:33.072635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:33.073366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:33.073804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:33.074231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:33.208062 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:33.216951 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:33.218403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:33.219599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-148dd193-95b6-4418-860a-939150a6b46d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1407 microversion: 2.20 time: 0.160085 Sep 23 15:25:33.220132 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 367/766] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:33 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:34.250825 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:34.251726 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:34.258834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:34.259307 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:34.259747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:34.260451 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:34.260942 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:34.261391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:34.393670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:34.402042 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:34.403496 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:34.404620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9b60d886-0881-4afd-8c4a-372827b18b79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1407 microversion: 2.20 time: 0.162020 Sep 23 15:25:34.405195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 400/767] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:34 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:35.433543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:35.434298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:35.445680 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:35.446471 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:35.447181 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:35.448275 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:35.449052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:35.449724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:35.453996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:35.589312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:35.601551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:35.603748 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:35.605447 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7090e4ed-0941-4e15-afb0-d65d67cc3996 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1407 microversion: 2.20 time: 0.178642 Sep 23 15:25:35.606178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 368/768] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:35 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:36.634510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:36.635281 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:36.644802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:36.645440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:36.646014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:36.646921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:36.647513 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:36.648068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:36.785395 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:36.794117 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:36.795555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:36.796697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-89432a30-4e4f-4667-83e7-6ef9159ce1d3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1407 microversion: 2.20 time: 0.167442 Sep 23 15:25:36.797343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 401/769] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:36 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:37.825156 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:37.825853 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:37.829015 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:37.835099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:37.835599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:37.836013 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:37.836734 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:37.837185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:37.837608 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:37.988519 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:38.001890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:38.003654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:38.004835 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-687d7223-b83e-4617-9b1c-6046a7a6a3ee tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1407 microversion: 2.20 time: 0.185482 Sep 23 15:25:38.005591 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 369/770] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:37 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:38.183741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-54f44ccd-b723-427b-becc-2f0575ba7d03 req-2be8b6f7-88d7-447a-9bad-e9d096948079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37411fb8-ca8b-42de-850e-3ca0d9c9d615", "name": "network-vif-plugged", "status": "completed", "tag": "5ce0bfbd-c402-457c-b397-3abfbebd324a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:38.192942 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:38.195323 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-54f44ccd-b723-427b-becc-2f0575ba7d03 req-2be8b6f7-88d7-447a-9bad-e9d096948079 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:38.195801 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-54f44ccd-b723-427b-becc-2f0575ba7d03 req-2be8b6f7-88d7-447a-9bad-e9d096948079 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:38.196229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-54f44ccd-b723-427b-becc-2f0575ba7d03 req-2be8b6f7-88d7-447a-9bad-e9d096948079 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:38.208768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-54f44ccd-b723-427b-becc-2f0575ba7d03 req-2be8b6f7-88d7-447a-9bad-e9d096948079 service nova] Creating event network-vif-plugged:5ce0bfbd-c402-457c-b397-3abfbebd324a for instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 on hv-cinder-85501 Sep 23 15:25:38.214160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-54f44ccd-b723-427b-becc-2f0575ba7d03 req-2be8b6f7-88d7-447a-9bad-e9d096948079 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033898 Sep 23 15:25:38.215143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 402/771] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:39.034079 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:39.035261 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:39.046235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:39.047047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:39.047779 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:39.048998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:39.049925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:39.050541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:39.192210 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:39.204938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:39.206880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:39.207999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d75a956c-df9b-4a6a-8c25-be3d37cc858e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1407 microversion: 2.20 time: 0.180593 Sep 23 15:25:39.208528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 370/772] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:39 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:40.241504 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:40.242175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=6 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:40.246804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:40.247531 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:40.255290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:40.255776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:40.256209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:40.256951 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:40.257406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:40.257832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:40.404621 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:40.413278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:40.414741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:40.415900 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8b827480-e91e-483f-b1b7-cae2585b3cbd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1600 microversion: 2.20 time: 0.175992 Sep 23 15:25:40.416455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 403/773] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:25:40 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:25:40.441979 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:40.442387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:40.444246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:40.450405 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:40.450886 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:40.451321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:40.452019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:40.452470 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:40.452911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:40.533384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c1acc399-8702-4967-89a1-e5b8350b1f7a tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096056 Sep 23 15:25:40.534015 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 371/774] 10.222.0.75 () {60 vars in 1316 bytes} [Fri Sep 23 15:25:40 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:25:41.722576 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-74efd03d-4d6c-4a8c-ba2f-fccb8af72560 req-40694233-2871-435f-9f78-054828091d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37411fb8-ca8b-42de-850e-3ca0d9c9d615", "tag": "5ce0bfbd-c402-457c-b397-3abfbebd324a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:41.734426 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-74efd03d-4d6c-4a8c-ba2f-fccb8af72560 req-40694233-2871-435f-9f78-054828091d5c service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:41.735049 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-74efd03d-4d6c-4a8c-ba2f-fccb8af72560 req-40694233-2871-435f-9f78-054828091d5c service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:41.735726 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-74efd03d-4d6c-4a8c-ba2f-fccb8af72560 req-40694233-2871-435f-9f78-054828091d5c service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:41.748156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-74efd03d-4d6c-4a8c-ba2f-fccb8af72560 req-40694233-2871-435f-9f78-054828091d5c service nova] Creating event network-changed:5ce0bfbd-c402-457c-b397-3abfbebd324a for instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 on hv-cinder-85501 Sep 23 15:25:41.753975 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-74efd03d-4d6c-4a8c-ba2f-fccb8af72560 req-40694233-2871-435f-9f78-054828091d5c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035166 Sep 23 15:25:41.754576 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 404/775] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:52.429082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=5 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:52.429931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=21 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:52.434157 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1495144302"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:52.434691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:52.441748 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:52.442235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:52.442673 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:52.443370 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:52.445016 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:52.445485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:52.580379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.network.security_group_api [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Removing security group 7176e855-f66e-4c07-87b2-ef74ca17013b from port 6cacb33d-3b2c-43b4-8086-7c7978b2aae6 Sep 23 15:25:52.901789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8bc9e2bc-2993-4b64-8c1f-6287207c911f tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "POST /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.474410 Sep 23 15:25:52.902413 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 372/776] 10.222.0.75 () {60 vars in 1278 bytes} [Fri Sep 23 15:25:52 2022] POST /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:25:52.908804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=5 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:52.909919 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=69 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:52.914322 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-a34d64be-49fb-41a2-ab16-ab7ca5836a61 req-379e143e-8da5-43bd-a924-d5cd0bcf51c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af869e43-152c-46fe-9759-c0b506650b1d", "tag": "6cacb33d-3b2c-43b4-8086-7c7978b2aae6"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:52.925315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a34d64be-49fb-41a2-ab16-ab7ca5836a61 req-379e143e-8da5-43bd-a924-d5cd0bcf51c1 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:52.925773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a34d64be-49fb-41a2-ab16-ab7ca5836a61 req-379e143e-8da5-43bd-a924-d5cd0bcf51c1 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:52.926196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a34d64be-49fb-41a2-ab16-ab7ca5836a61 req-379e143e-8da5-43bd-a924-d5cd0bcf51c1 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:52.939929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-a34d64be-49fb-41a2-ab16-ab7ca5836a61 req-379e143e-8da5-43bd-a924-d5cd0bcf51c1 service nova] Creating event network-changed:6cacb33d-3b2c-43b4-8086-7c7978b2aae6 for instance af869e43-152c-46fe-9759-c0b506650b1d on hv-cinder-85501 Sep 23 15:25:52.946405 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-a34d64be-49fb-41a2-ab16-ab7ca5836a61 req-379e143e-8da5-43bd-a924-d5cd0bcf51c1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038968 Sep 23 15:25:52.947742 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 405/777] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:53.690112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:53.690654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:53.697741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.697981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.698460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.699243 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.699940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.700424 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.792090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'services' on Instance uuid d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:53.878851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6f28eda6-de76-41d8-a562-dced12a2c2f7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments/32163891-7e70-4867-9af1-2022afa8c03e" status: 202 len: 0 microversion: 2.1 time: 0.192930 Sep 23 15:25:53.879851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 373/778] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:25:53 2022] DELETE /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments/32163891-7e70-4867-9af1-2022afa8c03e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:25:53.896437 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:53.899439 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:53.906807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.907602 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.908025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.908922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:53.909494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:53.909766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:53.947061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b52397ca-484f-4610-be16-5f1c79503a40 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062167 Sep 23 15:25:53.947694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 406/779] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:53 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:54.533030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:54.537679 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:54.540932 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.545336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.545336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.545336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.545336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.545770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.638594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lazy-loading 'services' on Instance uuid af869e43-152c-46fe-9759-c0b506650b1d {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:25:54.714985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b6bcf784-313d-483d-b33e-4ae4a3039b1b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "DELETE /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments/b9656a8b-3fe2-4ada-ae0d-dbeb06411367" status: 202 len: 0 microversion: 2.1 time: 0.186351 Sep 23 15:25:54.716413 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 374/780] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:25:54 2022] DELETE /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments/b9656a8b-3fe2-4ada-ae0d-dbeb06411367 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:25:54.723885 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:54.726575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:54.733151 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.733878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.734314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.735197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.735826 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.736407 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.767651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ea87161c-15cf-486b-b32a-d2184ce332f4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047639 Sep 23 15:25:54.768779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 407/781] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:54 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:54.960744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:54.963815 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:54.964458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-4ce6fabf-fe39-4e0d-914e-98d6b47fb229 req-7b3c3461-40ab-4119-8af8-c025733b716f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af869e43-152c-46fe-9759-c0b506650b1d", "tag": "6cacb33d-3b2c-43b4-8086-7c7978b2aae6"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:25:54.970455 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.970944 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.971377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.972090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.972544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.972994 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.974776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-4ce6fabf-fe39-4e0d-914e-98d6b47fb229 req-7b3c3461-40ab-4119-8af8-c025733b716f service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:54.975324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-4ce6fabf-fe39-4e0d-914e-98d6b47fb229 req-7b3c3461-40ab-4119-8af8-c025733b716f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:54.975821 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-4ce6fabf-fe39-4e0d-914e-98d6b47fb229 req-7b3c3461-40ab-4119-8af8-c025733b716f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:54.995049 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-4ce6fabf-fe39-4e0d-914e-98d6b47fb229 req-7b3c3461-40ab-4119-8af8-c025733b716f service nova] Creating event network-changed:6cacb33d-3b2c-43b4-8086-7c7978b2aae6 for instance af869e43-152c-46fe-9759-c0b506650b1d on hv-cinder-85501 Sep 23 15:25:55.001216 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-4ce6fabf-fe39-4e0d-914e-98d6b47fb229 req-7b3c3461-40ab-4119-8af8-c025733b716f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040043 Sep 23 15:25:55.002372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 408/782] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:25:55.010282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a96fd93b-b5d3-48f1-9970-4b9cfc7cfc49 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054077 Sep 23 15:25:55.010904 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 375/783] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:54 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:55.780806 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:55.783523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:55.790947 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:55.791444 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:55.791987 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:55.793490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:55.793490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:55.793760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:55.824097 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f297f405-2608-4e2f-bef5-9035625dfdfb tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047821 Sep 23 15:25:55.828911 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 409/784] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:55 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:25:56.022986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:56.025946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:56.032500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.032946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.033606 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.034632 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.035251 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.035683 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.067341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9949b9e5-5534-4bdc-a6d7-0f243e6c3bd4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048346 Sep 23 15:25:56.068423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 376/785] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:56 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:25:56.150182 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:56.150744 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:56.156706 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.157191 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.157624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.158315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.158769 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.159201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.183808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:25:56.273552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e8b1ef2c-f20b-4007-9b07-7da5488bdb26 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 204 len: 0 microversion: 2.1 time: 0.127269 Sep 23 15:25:56.274332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 410/786] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:25:56 2022] DELETE /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:25:56.283351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:56.283909 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:56.290201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.290672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.291154 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.291852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.292308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.292783 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.437728 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:56.448394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d5f52ab3-8909-412d-80db-7f894dcbe410 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1689 microversion: 2.1 time: 0.169197 Sep 23 15:25:56.449322 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 377/787] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:56 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:25:56.840223 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:56.842509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:56.849354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.849832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.850255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.850943 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.851390 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.851806 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.882508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-83d61ade-c45c-459b-a955-db76a5f0071b tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048038 Sep 23 15:25:56.883049 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 411/788] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:25:56 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:25:56.894199 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:56.894699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:56.901108 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.901595 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.902026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.902721 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:56.903173 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:56.903599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:56.983464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] HTTP exception thrown: Instance af869e43-152c-46fe-9759-c0b506650b1d is not attached to volume b9656a8b-3fe2-4ada-ae0d-dbeb06411367 Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Request method failure captured: Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: DELETE /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments/b9656a8b-3fe2-4ada-ae0d-dbeb06411367 HTTP/1.1 Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc8Zjx_pvZvwBR36hbLSHU0R8DRV99wsaYcvmxLB8mx54Q_-oUTS8tkIiA5Ba1omVFeX4GPqLPMoVk75SFimHYSiordq5ih15umcVFGQyWDov9JicTJ1AvSTeTyYFEL_QkCpFoFUfUGL6xkFYpAhEzvS3Zjwv8uLHNr8b8Duas-3IO0 Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 1b76f9eee7a14eb581dcdc19101fc774 Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-TestMinimumBasicScenario-738807732 Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:25:56.992620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1b76f9eee7a14eb581dcdc19101fc774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1b76f9eee7a14eb581dcdc19101fc774"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1b76f9eee7a14eb581dcdc19101fc774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1b76f9eee7a14eb581dcdc19101fc774"}]}] Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-TestMinimumBasicScenario-738807732 Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 1b76f9eee7a14eb581dcdc19101fc774 Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-TestMinimumBasicScenario-738807732 Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-TestMinimumBasicScenario-738807732-project Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 09d964117e9f449aaf3c768ccd395983 Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-TestMinimumBasicScenario-738807732-project Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:25:56.995718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance af869e43-152c-46fe-9759-c0b506650b1d is not attached to volume b9656a8b-3fe2-4ada-ae0d-dbeb06411367 Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'server_id': 'af869e43-152c-46fe-9759-c0b506650b1d', 'id': 'b9656a8b-3fe2-4ada-ae0d-dbeb06411367'} Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b9656a8b-3fe2-4ada-ae0d-dbeb06411367. Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:25:56.997235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af869e43-152c-46fe-9759-c0b506650b1d is not attached to volume b9656a8b-3fe2-4ada-ae0d-dbeb06411367 Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af869e43-152c-46fe-9759-c0b506650b1d is not attached to volume b9656a8b-3fe2-4ada-ae0d-dbeb06411367 Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:25:56.999440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Returning 404 to user: Instance af869e43-152c-46fe-9759-c0b506650b1d is not attached to volume b9656a8b-3fe2-4ada-ae0d-dbeb06411367 {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:25:57.001127 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-026d160a-9272-4bfe-a21d-aec5a87c02ac tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "DELETE /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments/b9656a8b-3fe2-4ada-ae0d-dbeb06411367" status: 404 len: 154 microversion: 2.1 time: 0.104123 Sep 23 15:25:57.001127 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 378/789] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:25:56 2022] DELETE /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d/os-volume_attachments/b9656a8b-3fe2-4ada-ae0d-dbeb06411367 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:25:57.472433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:57.473088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:57.479387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:57.479889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:57.480322 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:57.481059 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:57.481515 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:57.481930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:57.618645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:57.627114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e9ff4f26-72ba-41ae-998d-73e0ef057504 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1689 microversion: 2.1 time: 0.158919 Sep 23 15:25:57.627721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 412/790] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:57 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:58.146133 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:58.146670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:58.153512 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.153997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.154433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.155095 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.155579 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.155999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.181652 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:25:58.263327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a91704a6-f9af-4dfd-a033-017788b291ee tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "DELETE /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 204 len: 0 microversion: 2.1 time: 0.120380 Sep 23 15:25:58.264342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 379/791] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:25:58 2022] DELETE /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:25:58.276046 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:58.276946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:58.284549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.285139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.285585 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.286277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.286723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.287144 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.429172 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:58.437673 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cf7522a8-cec5-4d59-9c4e-cf6e937648ad tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1556 microversion: 2.1 time: 0.167427 Sep 23 15:25:58.438251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 413/792] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:58 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:58.653740 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:58.654395 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:58.661246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.661766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.662225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.662961 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:58.663442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:58.663892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:58.805542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:58.818383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ef6c44d6-197d-449f-a201-32841113ef07 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1689 microversion: 2.1 time: 0.169839 Sep 23 15:25:58.819249 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 380/793] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:58 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:59.463510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:59.464132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:59.474210 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:59.474938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:59.475596 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:59.476694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:59.477511 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:59.478268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:59.638373 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:25:59.646320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ec405adc-ab00-4a82-9959-695df34a5377 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1556 microversion: 2.1 time: 0.188987 Sep 23 15:25:59.646866 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 414/794] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:59 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:25:59.844990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:25:59.845605 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:25:59.852842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:59.853437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:59.853862 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:59.854564 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:25:59.855001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:25:59.855433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:25:59.998976 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:00.007535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b105e0a3-c8de-484a-b2bc-7e54a3af5499 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1689 microversion: 2.1 time: 0.168451 Sep 23 15:26:00.008113 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 381/795] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:25:59 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:00.673671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:00.674562 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:00.683845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:00.684326 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:00.684784 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:00.685474 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:00.685918 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:00.686334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:00.819405 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:00.830886 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0d2e49a5-8778-4e0f-966c-25cde82c2ab2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1556 microversion: 2.1 time: 0.163554 Sep 23 15:26:00.831637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 415/796] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:00 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:01.034872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:01.035759 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:01.044145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:01.044619 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:01.045107 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:01.045808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:01.046269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:01.046694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:01.179155 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:01.187661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ef2d76a8-5598-4538-af2f-d0c35e03e42b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1689 microversion: 2.1 time: 0.159411 Sep 23 15:26:01.188235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 382/797] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:01 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:01.857130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:01.858360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:01.866015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:01.866730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:01.867172 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:01.867879 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:01.868480 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:01.868984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.001777 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:02.009926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e8197569-ec7d-4960-98a7-54621f3420d2 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1556 microversion: 2.1 time: 0.156911 Sep 23 15:26:02.010504 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 416/798] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:01 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:02.211150 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:02.211795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:02.218586 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.219084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.219522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.220227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.220716 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.221146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.485290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:02.493663 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ef02257d-ae0d-4f9b-9285-edf0578e422d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1689 microversion: 2.1 time: 0.286289 Sep 23 15:26:02.494384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 383/799] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:02 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1689 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:02.950295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:02.953424 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:02.971678 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.972531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.973189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:02.974028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:02.974537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:02.975046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.023770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-480e7ded-b034-4f17-ab8e-4c66e170706c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078042 Sep 23 15:26:03.024771 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 384/800] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:26:02 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:26:03.041339 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-171fc0f7-c1b7-4598-8714-7661ee2ac442 req-30eb28a0-a20d-47d1-8577-d6eb2eeb6051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25", "name": "network-vif-deleted", "tag": "306b9553-4640-49fe-82dd-dd744475cdb3"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:03.063172 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-171fc0f7-c1b7-4598-8714-7661ee2ac442 req-30eb28a0-a20d-47d1-8577-d6eb2eeb6051 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.063987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-171fc0f7-c1b7-4598-8714-7661ee2ac442 req-30eb28a0-a20d-47d1-8577-d6eb2eeb6051 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.064772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-171fc0f7-c1b7-4598-8714-7661ee2ac442 req-30eb28a0-a20d-47d1-8577-d6eb2eeb6051 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.065372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-a577f105-ac97-43f7-90cd-53a871371621 req-5290dea6-dd08-4f02-8266-3fd62f66965a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af869e43-152c-46fe-9759-c0b506650b1d", "name": "network-vif-deleted", "tag": "6cacb33d-3b2c-43b4-8086-7c7978b2aae6"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:03.080406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-171fc0f7-c1b7-4598-8714-7661ee2ac442 req-30eb28a0-a20d-47d1-8577-d6eb2eeb6051 service nova] Creating event network-vif-deleted:306b9553-4640-49fe-82dd-dd744475cdb3 for instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 on hv-cinder-85501 Sep 23 15:26:03.087424 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-171fc0f7-c1b7-4598-8714-7661ee2ac442 req-30eb28a0-a20d-47d1-8577-d6eb2eeb6051 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061007 Sep 23 15:26:03.088808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 385/801] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:03.091265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a577f105-ac97-43f7-90cd-53a871371621 req-5290dea6-dd08-4f02-8266-3fd62f66965a service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.092007 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a577f105-ac97-43f7-90cd-53a871371621 req-5290dea6-dd08-4f02-8266-3fd62f66965a service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.092771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a577f105-ac97-43f7-90cd-53a871371621 req-5290dea6-dd08-4f02-8266-3fd62f66965a service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.102674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:03.103718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:03.113227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-a577f105-ac97-43f7-90cd-53a871371621 req-5290dea6-dd08-4f02-8266-3fd62f66965a service nova] Creating event network-vif-deleted:6cacb33d-3b2c-43b4-8086-7c7978b2aae6 for instance af869e43-152c-46fe-9759-c0b506650b1d on hv-cinder-85501 Sep 23 15:26:03.114737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.115912 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.116797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.117744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.118819 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.119486 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.126170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-a577f105-ac97-43f7-90cd-53a871371621 req-5290dea6-dd08-4f02-8266-3fd62f66965a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253103 Sep 23 15:26:03.126956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 417/802] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:03.152690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:03.173652 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.174396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.174976 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.175574 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lazy-loading 'fault' on Instance uuid af869e43-152c-46fe-9759-c0b506650b1d {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:03.211791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:03.212520 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:03.229521 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.230032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.233546 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.234668 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.237712 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.238377 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.244094 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:03.254017 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5a72535b-ba6b-4131-a913-8d600f19c887 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1349 microversion: 2.1 time: 0.163693 Sep 23 15:26:03.254685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 386/803] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:03 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1349 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:03.298963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:26:03.406237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d2919705-4a8f-449b-85f9-77888a71a39c tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 204 len: 0 microversion: 2.1 time: 0.198511 Sep 23 15:26:03.406835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 418/804] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:26:03 2022] DELETE /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:26:03.415357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:03.416156 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:03.422346 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.422904 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.423570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.424328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.424946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.425560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.517751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:03.518442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:03.524566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.525076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.525510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.526205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.526648 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.527414 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.566247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:03.566401 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:03.566738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:03.567170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:03.567620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'fault' on Instance uuid d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:03.575053 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-234f9df9-4b61-4acd-a8f3-a7ca5462da47 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1672 microversion: 2.1 time: 0.163722 Sep 23 15:26:03.575622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 387/805] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:03 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:03.612945 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:03.618931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:03.625330 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1ea5340f-2e6c-46b7-a860-f6286ffeb015 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1336 microversion: 2.1 time: 0.111709 Sep 23 15:26:03.625922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 419/806] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:03 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:26:04.277639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:04.278152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:04.286474 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.286955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.287569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.288279 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.288916 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.289348 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.322249 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.322641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.323080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.323531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lazy-loading 'fault' on Instance uuid af869e43-152c-46fe-9759-c0b506650b1d {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:04.365574 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d964117e9f449aaf3c768ccd395983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b76f9eee7a14eb581dcdc19101fc774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:04.373898 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9169bf27-5ac4-4fa8-9b17-08bf209b4c91 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 200 len: 1349 microversion: 2.1 time: 0.100499 Sep 23 15:26:04.374443 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 388/807] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:04 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:04.601010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:04.601593 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:04.609424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.609931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.610387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.611052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.611504 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.611943 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.647558 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:04.648169 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:04.655000 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.655497 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.655935 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.656648 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.657125 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.657551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.689176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:04.689658 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:04.690090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:04.690532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'fault' on Instance uuid d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:04.731898 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:04.739635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-98046290-c47a-4555-88da-467482f93b4d tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 200 len: 1336 microversion: 2.1 time: 0.095961 Sep 23 15:26:04.747973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 389/808] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:04 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:04.748314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:04.755217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8e0d525b-63d9-408d-b21d-b45990bbb6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1672 microversion: 2.1 time: 0.158497 Sep 23 15:26:04.755773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 420/809] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:04 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:05.397069 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:05.397642 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] [instance: af869e43-152c-46fe-9759-c0b506650b1d] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:05.404523 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:05.405045 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:05.405473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:05.406166 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:05.406609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:05.407027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:05.421343 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] HTTP exception thrown: Instance af869e43-152c-46fe-9759-c0b506650b1d could not be found. Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Request method failure captured: Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d HTTP/1.1 Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc8Zjx_pvZvwBR36hbLSHU0R8DRV99wsaYcvmxLB8mx54Q_-oUTS8tkIiA5Ba1omVFeX4GPqLPMoVk75SFimHYSiordq5ih15umcVFGQyWDov9JicTJ1AvSTeTyYFEL_QkCpFoFUfUGL6xkFYpAhEzvS3Zjwv8uLHNr8b8Duas-3IO0 Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 1b76f9eee7a14eb581dcdc19101fc774 Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-TestMinimumBasicScenario-738807732 Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:26:05.423071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1b76f9eee7a14eb581dcdc19101fc774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1b76f9eee7a14eb581dcdc19101fc774"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1b76f9eee7a14eb581dcdc19101fc774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1b76f9eee7a14eb581dcdc19101fc774"}]}] Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-TestMinimumBasicScenario-738807732 Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 1b76f9eee7a14eb581dcdc19101fc774 Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-TestMinimumBasicScenario-738807732 Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-TestMinimumBasicScenario-738807732-project Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 09d964117e9f449aaf3c768ccd395983 Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-TestMinimumBasicScenario-738807732-project Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance af869e43-152c-46fe-9759-c0b506650b1d could not be found. Sep 23 15:26:05.424462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'af869e43-152c-46fe-9759-c0b506650b1d'} Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af869e43-152c-46fe-9759-c0b506650b1d could not be found. Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:05.425266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af869e43-152c-46fe-9759-c0b506650b1d could not be found. Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af869e43-152c-46fe-9759-c0b506650b1d could not be found. Sep 23 15:26:05.426502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.428550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Returning 404 to user: Instance af869e43-152c-46fe-9759-c0b506650b1d could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:05.428550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-df2164d9-dd07-419f-a670-9f7d2be34246 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d" status: 404 len: 111 microversion: 2.1 time: 0.031514 Sep 23 15:26:05.428550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 390/810] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:05 2022] GET /compute/v2.1/servers/af869e43-152c-46fe-9759-c0b506650b1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:05.433511 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-07651bf9-d13f-4fc1-8dcd-9c926e8478a4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] Calling method '.version_select at 0x7fbb02fba280>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:05.456011 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-07651bf9-d13f-4fc1-8dcd-9c926e8478a4 tempest-TestMinimumBasicScenario-738807732 tempest-TestMinimumBasicScenario-738807732-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1972542435" status: 202 len: 0 microversion: 2.1 time: 0.026358 Sep 23 15:26:05.459882 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 421/811] 10.222.0.75 () {58 vars in 1272 bytes} [Fri Sep 23 15:26:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1972542435 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:26:05.766928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:05.767622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:05.774304 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:05.774799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:05.775236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:05.776197 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:05.776714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:05.777141 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:05.783729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:05.785198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:05.793917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] HTTP exception thrown: Instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 could not be found. Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Request method failure captured: Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 HTTP/1.1 Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc4v9pxEJ1GpUW2lHlRNm3QpF5nvIevVMf9lP9v--RxSo7eSx4YJ-Deu_hBvtd-nl2xQdH0M6DPTGxOeQ1bepbh069Zba1lVXk6rl9ZJG1TZcCvKiBttYubPPwOANtZ3iLeWQ1YPshCdqdA3vVdRIIucD8Z-7bzSBbWjWZtTATOH78c Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:26:05.795685 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1abe4f1508864f77b30c4c635c368f02"}]}] Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 4cfac62e1c304167abb971815d5da358 Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 could not be found. Sep 23 15:26:05.797192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'd1b9e193-5eb8-4876-ba58-a8e1ccf5ea25'} Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 could not be found. Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:05.798009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 could not be found. Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 could not be found. Sep 23 15:26:05.799400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:26:05.801339 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Returning 404 to user: Instance d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:05.803275 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2eddd315-39b8-45bd-8530-45c6706f47c3 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25" status: 404 len: 111 microversion: 2.1 time: 0.040386 Sep 23 15:26:05.804055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 391/812] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:05 2022] GET /compute/v2.1/servers/d1b9e193-5eb8-4876-ba58-a8e1ccf5ea25 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:05.809282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:05.809822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:05.810324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:05.811160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:05.811844 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:05.812266 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:05.820164 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d3180602-f665-4576-b096-3877af457924 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '.version_select at 0x7fbb02c5ce50>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:05.870151 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d3180602-f665-4576-b096-3877af457924 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071805779" status: 202 len: 0 microversion: 2.1 time: 0.061524 Sep 23 15:26:05.871452 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 392/813] 10.222.0.75 () {58 vars in 1221 bytes} [Fri Sep 23 15:26:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071805779 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:26:05.904840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:05.919245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-06e773ad-8701-4a67-80a6-83c0a1313747 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 200 len: 1604 microversion: 2.1 time: 0.144430 Sep 23 15:26:05.920896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 422/814] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:05 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 1604 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:26:06.013640 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-7467533d-aa30-4acd-bd3a-2987192e845d req-af0fbc89-a678-4856-af9c-492d9ad38d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b92954-0cb5-4c21-ab67-8f80c5be9eb9", "name": "network-vif-deleted", "tag": "5073b565-7790-42c1-a11b-5c4328b5da4a"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:06.032674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7467533d-aa30-4acd-bd3a-2987192e845d req-af0fbc89-a678-4856-af9c-492d9ad38d1c service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:06.039290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7467533d-aa30-4acd-bd3a-2987192e845d req-af0fbc89-a678-4856-af9c-492d9ad38d1c service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:06.039939 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7467533d-aa30-4acd-bd3a-2987192e845d req-af0fbc89-a678-4856-af9c-492d9ad38d1c service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:06.066496 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-7467533d-aa30-4acd-bd3a-2987192e845d req-af0fbc89-a678-4856-af9c-492d9ad38d1c service nova] Creating event network-vif-deleted:5073b565-7790-42c1-a11b-5c4328b5da4a for instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 on hv-cinder-85501 Sep 23 15:26:06.082545 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-7467533d-aa30-4acd-bd3a-2987192e845d req-af0fbc89-a678-4856-af9c-492d9ad38d1c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072982 Sep 23 15:26:06.084087 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 393/815] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:06.946216 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:06.947642 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:06.955225 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:06.955796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:06.956411 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:06.958255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:06.959308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:06.959938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:06.979131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] HTTP exception thrown: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Request method failure captured: Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 HTTP/1.1 Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc42CbjD5rkNFCjdSZ33QHnjvF1a0FY5zke0K0C3qLTjYjVQ5FARfCoe67x1-IXVdS9oTI2xld0fS2C75lBByxVxokbE2KriuPPwKJ5ucyzwucZ7QLOReSCbHMwnY1-u8FH06TDY7CEx1OxHHDVX7nwRhGFmGfwDUmG0uweZMlzQj6g Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:26:06.982434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d4fd7ca907fa4806904e1c00b21b5447"}]}] Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4bded8b580f34e08b2890eb3430f4b80 Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:26:06.983816 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'b9b92954-0cb5-4c21-ab67-8f80c5be9eb9'} Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:06.984634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:26:06.985847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:06.986907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Returning 404 to user: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:06.986907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bf17b4dd-d80a-4b10-b5b5-d8990687c188 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 404 len: 111 microversion: 2.1 time: 0.041789 Sep 23 15:26:06.986907 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 423/816] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:06 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:06.993366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-73eb2ac9-31ad-4ff3-af90-12b294bc34c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '.version_select at 0x7fbb02dc2af0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:07.023558 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-73eb2ac9-31ad-4ff3-af90-12b294bc34c6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788673810" status: 202 len: 0 microversion: 2.1 time: 0.034262 Sep 23 15:26:07.024142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 394/817] 10.222.0.75 () {58 vars in 1221 bytes} [Fri Sep 23 15:26:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788673810 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:26:07.738691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e1b3d756-0c3c-4b95-8cab-c5c713346f51 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'create', calling method: .version_select at 0x7fbb02f02820>, body: {"keypair": {"name": "tempest-keypair-1473538077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAs2V/rJUbsIEEy3YbkwU9x1cTdFbT8uj7n67k2zS+izJIS0EULZF9vcvKLEuHLICb90CfAaU6FIwcRvMsWgqs0EaVljAeFwBWsgE2VxwLALqm0g7pmY+kUaD5+bf7axBA=="}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:07.755680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-e1b3d756-0c3c-4b95-8cab-c5c713346f51 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Getting quotas for project d4fd7ca907fa4806904e1c00b21b5447. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:26:07.759794 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-e1b3d756-0c3c-4b95-8cab-c5c713346f51 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Getting quotas for user 4bded8b580f34e08b2890eb3430f4b80 and project d4fd7ca907fa4806904e1c00b21b5447. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:26:07.782812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e1b3d756-0c3c-4b95-8cab-c5c713346f51 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048488 Sep 23 15:26:07.783545 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 424/818] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:26:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:09.835385 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:09.836002 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:09.843152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.843871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.844309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.845046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.845693 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.846294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.879274 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:26:09.963453 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e262d275-e008-4d47-a587-45060948f331 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 204 len: 0 microversion: 2.1 time: 0.132498 Sep 23 15:26:09.964609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 395/819] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:26:09 2022] DELETE /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:26:09.973321 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:09.974085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:09.980992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.981486 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.981924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:09.982634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:09.983088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:09.983512 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:10.116682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:10.125680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-230bc7a1-6a1f-4fa8-8775-174d2aac9941 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1506 microversion: 2.1 time: 0.156494 Sep 23 15:26:10.126272 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 425/820] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:09 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:10.284970 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1090690557", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b94c7d0-0c4f-4356-ac0d-a0345dcfe903"}], "security_groups": [{"name": "tempest-securitygroup--44736150"}], "key_name": "tempest-keypair-1473538077", "user_data": "}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:10.408091 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] validate_networks() for [('2b94c7d0-0c4f-4356-ac0d-a0345dcfe903', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:26:10.857691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:26:10.858259 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:26:10.858787 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:26:10.859191 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:26:10.859815 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:26:10.873767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:10.874427 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:10.875070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:10.876080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:10.877144 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:10.877722 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:10.902109 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Getting quotas for project d4fd7ca907fa4806904e1c00b21b5447. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:26:10.908660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Getting quotas for user 4bded8b580f34e08b2890eb3430f4b80 and project d4fd7ca907fa4806904e1c00b21b5447. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:26:10.922613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:26:10.925171 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:26:10.985325 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cf59070e-ea05-4c92-b1c9-63254d5ddd45 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.706633 Sep 23 15:26:10.986538 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 396/821] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:26:10 2022] POST /compute/v2.1/servers => generated 400 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:26:10.998072 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cdc9640d-29f5-4f51-b6c4-5a2a2588b3ee tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:10.999020 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cdc9640d-29f5-4f51-b6c4-5a2a2588b3ee tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:11.082956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cdc9640d-29f5-4f51-b6c4-5a2a2588b3ee tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:11.091925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cdc9640d-29f5-4f51-b6c4-5a2a2588b3ee tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1238 microversion: 2.1 time: 0.098114 Sep 23 15:26:11.092954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 426/822] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:10 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:26:11.149549 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:11.150132 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:11.157763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.158581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.158964 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.159672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.160119 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.160925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.303626 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:11.314541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-73a19787-d5d1-4aaf-8f07-50d538ffe8b0 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1506 microversion: 2.1 time: 0.169722 Sep 23 15:26:11.315642 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 397/823] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:11 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:11.821913 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-6dc774e1-44bd-4f43-82e8-254baa83886a req-55fb37a2-4aca-43b0-9825-6565c453d148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d9677f-fe5a-4549-91b7-4657540ae97f", "name": "network-vif-deleted", "tag": "70760e9f-6d22-46eb-aa3e-f9e855dbf739"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:11.848615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-6dc774e1-44bd-4f43-82e8-254baa83886a req-55fb37a2-4aca-43b0-9825-6565c453d148 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:11.850502 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-6dc774e1-44bd-4f43-82e8-254baa83886a req-55fb37a2-4aca-43b0-9825-6565c453d148 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:11.850936 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-6dc774e1-44bd-4f43-82e8-254baa83886a req-55fb37a2-4aca-43b0-9825-6565c453d148 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:11.864030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-6dc774e1-44bd-4f43-82e8-254baa83886a req-55fb37a2-4aca-43b0-9825-6565c453d148 service nova] Creating event network-vif-deleted:70760e9f-6d22-46eb-aa3e-f9e855dbf739 for instance a7d9677f-fe5a-4549-91b7-4657540ae97f on hv-cinder-85501 Sep 23 15:26:11.887023 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-6dc774e1-44bd-4f43-82e8-254baa83886a req-55fb37a2-4aca-43b0-9825-6565c453d148 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065660 Sep 23 15:26:11.889670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 427/824] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:12.123970 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:12.125543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:12.133368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.134326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.135369 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.136615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.137609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.138056 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.222655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:12.233334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-02fd7c83-b9e6-44bd-a757-013d1bdaa785 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1234 microversion: 2.1 time: 0.114703 Sep 23 15:26:12.235575 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 398/825] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:12 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1234 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:12.338766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:12.339361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:12.346237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.347132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.347668 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.348468 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.349017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.349509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.383683 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:12.384120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:12.384555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:12.385262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'fault' on Instance uuid a7d9677f-fe5a-4549-91b7-4657540ae97f {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:12.437842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:12.446032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-177647d2-e002-4f89-a50a-445e46e9979b tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1311 microversion: 2.1 time: 0.111637 Sep 23 15:26:12.446532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 428/826] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:12 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:13.266279 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:13.268363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:13.281668 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.282699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.283255 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.284364 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.285115 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.285599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.455940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:13.471150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:13.472662 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:13.479246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-13e8c7a6-3b64-4faa-9145-ae29b0e3f123 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1298 microversion: 2.1 time: 0.222709 Sep 23 15:26:13.481803 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.497626 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 399/827] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:13 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1298 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:13.498708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.499173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.500027 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.502104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.503069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.543992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:13.544483 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:13.544949 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:13.545567 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'fault' on Instance uuid a7d9677f-fe5a-4549-91b7-4657540ae97f {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:13.593564 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:13.604070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5d760ea9-5292-4e02-a2a5-0576358b871f tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 200 len: 1311 microversion: 2.1 time: 0.137565 Sep 23 15:26:13.606188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 429/828] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:13 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:14.510421 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:14.511901 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:14.522319 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.523176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.523982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.524754 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.525274 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.525677 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.650837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:14.652372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: a7d9677f-fe5a-4549-91b7-4657540ae97f] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:14.687078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.687912 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.689837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.691388 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.695589 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.696505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.742670 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] HTTP exception thrown: Instance a7d9677f-fe5a-4549-91b7-4657540ae97f could not be found. Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Request method failure captured: Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f HTTP/1.1 Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4v9pxEJ1GpUW2lHlRNm3QpF5nvIevVMf9lP9v--RxSo7eSx4YJ-Deu_hBvtd-nl2xQdH0M6DPTGxOeQ1bepbh069Zba1lVXk6rl9ZJG1TZcCvKiBttYubPPwOANtZ3iLeWQ1YPshCdqdA3vVdRIIucD8Z-7bzSBbWjWZtTATOH78c Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:26:14.744495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1abe4f1508864f77b30c4c635c368f02"}]}] Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4cfac62e1c304167abb971815d5da358 Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance a7d9677f-fe5a-4549-91b7-4657540ae97f could not be found. Sep 23 15:26:14.746233 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'a7d9677f-fe5a-4549-91b7-4657540ae97f'} Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d9677f-fe5a-4549-91b7-4657540ae97f could not be found. Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:14.746989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d9677f-fe5a-4549-91b7-4657540ae97f could not be found. Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d9677f-fe5a-4549-91b7-4657540ae97f could not be found. Sep 23 15:26:14.748196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:14.761385 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Returning 404 to user: Instance a7d9677f-fe5a-4549-91b7-4657540ae97f could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:14.765227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6e61e137-d606-47df-ac62-dbce09496766 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f" status: 404 len: 111 microversion: 2.1 time: 0.139617 Sep 23 15:26:14.769531 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 430/829] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:14 2022] GET /compute/v2.1/servers/a7d9677f-fe5a-4549-91b7-4657540ae97f => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:14.776617 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:14.780575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:14.788015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.788566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.789101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.790024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:14.790637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:14.791377 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:14.843702 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:26:14.851718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:14.864542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d1993b1d-0a9d-4942-b062-3215e6084999 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1362 microversion: 2.1 time: 0.358980 Sep 23 15:26:14.869780 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 400/830] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:14 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:14.973630 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fbed02fb-ecd8-457f-a5a3-e9c0ea047ab2 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 204 len: 0 microversion: 2.1 time: 0.200489 Sep 23 15:26:14.977018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 431/831] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:26:14 2022] DELETE /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:26:14.985334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:14.986465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:15.001294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.003564 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.004808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.005665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.006065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.006720 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.189012 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-f10a5455-2c35-4509-87af-2a372b54098a req-e0fff043-232b-4a8e-b090-f84404f90a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b9f1d7-4143-4d97-af21-d148c232a438", "tag": "75e7bdc4-43db-4f8f-878c-111d10f4749a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:15.206087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f10a5455-2c35-4509-87af-2a372b54098a req-e0fff043-232b-4a8e-b090-f84404f90a18 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.206576 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f10a5455-2c35-4509-87af-2a372b54098a req-e0fff043-232b-4a8e-b090-f84404f90a18 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.207007 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f10a5455-2c35-4509-87af-2a372b54098a req-e0fff043-232b-4a8e-b090-f84404f90a18 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.221849 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-f10a5455-2c35-4509-87af-2a372b54098a req-e0fff043-232b-4a8e-b090-f84404f90a18 service nova] Creating event network-changed:75e7bdc4-43db-4f8f-878c-111d10f4749a for instance 21b9f1d7-4143-4d97-af21-d148c232a438 on hv-cinder-85501 Sep 23 15:26:15.230701 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-f10a5455-2c35-4509-87af-2a372b54098a req-e0fff043-232b-4a8e-b090-f84404f90a18 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046060 Sep 23 15:26:15.231633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 432/832] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:15.304992 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:15.313183 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-aaf72398-623e-4e81-b0b6-d2952a2f5217 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.333009 Sep 23 15:26:15.313884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 401/833] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:14 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:15.897846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:15.898550 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:15.907029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.907566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.908067 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:15.909183 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:15.909934 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:15.910412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:16.055991 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:16.063913 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0891f315-c24c-42cc-b172-ea0528c6417e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1362 microversion: 2.1 time: 0.172091 Sep 23 15:26:16.064876 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 433/834] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:15 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:16.337055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:16.337699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:16.341405 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:16.345231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:16.345725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:16.346148 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:16.346850 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:16.347303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:16.347724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:16.773901 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:16.781798 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3225689e-4dd2-4623-b41a-292519f244aa tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.448706 Sep 23 15:26:16.782485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 402/835] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:16 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:17.088570 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:17.089689 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:17.097934 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:17.098401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:17.099104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:17.099831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:17.100311 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:17.100767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:17.275797 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:17.284101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8e5ee299-bb01-4ec6-920e-34ea6262f93f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1362 microversion: 2.1 time: 0.199874 Sep 23 15:26:17.284766 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 434/836] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:17 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:17.809110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:17.809749 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:17.816343 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:17.816874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:17.817313 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:17.818027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:17.818483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:17.818905 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:18.032538 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:18.041080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4d7eb599-59b0-493f-96ce-60c26acb0d84 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1522 microversion: 2.1 time: 0.237965 Sep 23 15:26:18.041613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 403/837] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:17 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:18.241440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-9b53d07a-08b7-43dd-8f26-89763231ee4d req-d367ce28-31af-455d-ac1a-31ef89d34834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c685e650-6379-4809-8cec-3549d4a26ab1", "name": "network-vif-deleted", "tag": "2cdd4723-27d8-4995-a49c-6967ba24fa7e"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:18.248254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:18.254051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-9b53d07a-08b7-43dd-8f26-89763231ee4d req-d367ce28-31af-455d-ac1a-31ef89d34834 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:18.254559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-9b53d07a-08b7-43dd-8f26-89763231ee4d req-d367ce28-31af-455d-ac1a-31ef89d34834 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:18.254988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-9b53d07a-08b7-43dd-8f26-89763231ee4d req-d367ce28-31af-455d-ac1a-31ef89d34834 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:18.267783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-9b53d07a-08b7-43dd-8f26-89763231ee4d req-d367ce28-31af-455d-ac1a-31ef89d34834 service nova] Creating event network-vif-deleted:2cdd4723-27d8-4995-a49c-6967ba24fa7e for instance c685e650-6379-4809-8cec-3549d4a26ab1 on hv-cinder-85501 Sep 23 15:26:18.272795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-9b53d07a-08b7-43dd-8f26-89763231ee4d req-d367ce28-31af-455d-ac1a-31ef89d34834 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035266 Sep 23 15:26:18.273397 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 435/838] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:18.307469 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:18.308085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:18.314706 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:18.315200 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:18.315641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:18.316322 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:18.316839 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:18.317268 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:18.458955 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:18.467699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2e71487a-e9e1-414b-9758-b1df6e462ba4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1362 microversion: 2.1 time: 0.164184 Sep 23 15:26:18.468266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 404/839] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:18 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:19.070490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:19.071723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:19.079462 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:19.079953 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:19.080388 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:19.081146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:19.081604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:19.082030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:19.146010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:19.158996 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1557ad78-2539-4969-a3a9-d5a42259e3c7 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1480 microversion: 2.1 time: 0.095895 Sep 23 15:26:19.159773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 436/840] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:19 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1480 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:19.494532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:19.495416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:19.503743 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:19.504230 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:19.504696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:19.505375 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:19.505819 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:19.506232 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:19.510234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:19.646602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:19.658807 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-87d5461d-41eb-4c8c-b4c8-f1d595d547b2 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1362 microversion: 2.1 time: 0.170656 Sep 23 15:26:19.659608 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 405/841] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:19 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:20.185209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:20.185813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:20.192563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:20.193116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:20.193550 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:20.194263 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:20.194720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:20.195135 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:20.240417 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:20.241195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:20.241955 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:20.242665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lazy-loading 'fault' on Instance uuid c685e650-6379-4809-8cec-3549d4a26ab1 {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:20.289708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfac62e1c304167abb971815d5da358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abe4f1508864f77b30c4c635c368f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:20.297779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c4cf7817-c866-4220-a797-fe6aa72f74d4 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 200 len: 1312 microversion: 2.1 time: 0.116814 Sep 23 15:26:20.298348 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 437/842] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:20 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:20.690423 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:20.691271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:20.701737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:20.702229 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:20.702669 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:20.703450 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:20.703911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:20.704340 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:20.840581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:20.848856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-95ad80d4-9df1-4769-b7a8-02b083b99141 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1362 microversion: 2.1 time: 0.165694 Sep 23 15:26:20.849549 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 406/843] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:20 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:21.322746 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:21.323306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] [instance: c685e650-6379-4809-8cec-3549d4a26ab1] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:21.325376 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=6 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:21.331649 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:21.332124 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:21.332550 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:21.333339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:21.333781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:21.334186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:21.350504 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] HTTP exception thrown: Instance c685e650-6379-4809-8cec-3549d4a26ab1 could not be found. Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Request method failure captured: Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 HTTP/1.1 Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4v9pxEJ1GpUW2lHlRNm3QpF5nvIevVMf9lP9v--RxSo7eSx4YJ-Deu_hBvtd-nl2xQdH0M6DPTGxOeQ1bepbh069Zba1lVXk6rl9ZJG1TZcCvKiBttYubPPwOANtZ3iLeWQ1YPshCdqdA3vVdRIIucD8Z-7bzSBbWjWZtTATOH78c Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:26:21.352200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1abe4f1508864f77b30c4c635c368f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1abe4f1508864f77b30c4c635c368f02"}]}] Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 1abe4f1508864f77b30c4c635c368f02 Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-656590992 Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4cfac62e1c304167abb971815d5da358 Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-ServerRescueNegativeTestJSON-656590992-project Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance c685e650-6379-4809-8cec-3549d4a26ab1 could not be found. Sep 23 15:26:21.353856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'c685e650-6379-4809-8cec-3549d4a26ab1'} Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c685e650-6379-4809-8cec-3549d4a26ab1 could not be found. Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:21.354771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c685e650-6379-4809-8cec-3549d4a26ab1 could not be found. Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c685e650-6379-4809-8cec-3549d4a26ab1 could not be found. Sep 23 15:26:21.356396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:21.357775 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] Returning 404 to user: Instance c685e650-6379-4809-8cec-3549d4a26ab1 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:21.357775 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c1b4e29f-3379-4a21-9428-409b2e908825 tempest-ServerRescueNegativeTestJSON-656590992 tempest-ServerRescueNegativeTestJSON-656590992-project] 10.222.0.75 "GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1" status: 404 len: 111 microversion: 2.1 time: 0.034850 Sep 23 15:26:21.357775 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 438/844] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:21 2022] GET /compute/v2.1/servers/c685e650-6379-4809-8cec-3549d4a26ab1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:21.872027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:21.872718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:21.874535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:21.875234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:21.882987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:21.883478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:21.883915 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:21.884848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:21.885301 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:21.885725 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:22.122406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:22.130586 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-db313d9f-4379-479f-8d1e-c0cc44ce52be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1362 microversion: 2.1 time: 0.262897 Sep 23 15:26:22.131163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 407/845] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:21 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:22.520116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-4c3e475f-90fb-43dd-8fd0-2ff581ffdeea req-b8516102-bb97-4e3a-8231-7833172af8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b9f1d7-4143-4d97-af21-d148c232a438", "name": "network-vif-plugged", "status": "completed", "tag": "75e7bdc4-43db-4f8f-878c-111d10f4749a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:22.531010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-4c3e475f-90fb-43dd-8fd0-2ff581ffdeea req-b8516102-bb97-4e3a-8231-7833172af8a9 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:22.531494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-4c3e475f-90fb-43dd-8fd0-2ff581ffdeea req-b8516102-bb97-4e3a-8231-7833172af8a9 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:22.531923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-4c3e475f-90fb-43dd-8fd0-2ff581ffdeea req-b8516102-bb97-4e3a-8231-7833172af8a9 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:22.560571 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-4c3e475f-90fb-43dd-8fd0-2ff581ffdeea req-b8516102-bb97-4e3a-8231-7833172af8a9 service nova] Creating event network-vif-plugged:75e7bdc4-43db-4f8f-878c-111d10f4749a for instance 21b9f1d7-4143-4d97-af21-d148c232a438 on hv-cinder-85501 Sep 23 15:26:22.568852 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-4c3e475f-90fb-43dd-8fd0-2ff581ffdeea req-b8516102-bb97-4e3a-8231-7833172af8a9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052497 Sep 23 15:26:22.569983 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 439/846] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:23.154416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:23.155749 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:23.162732 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:23.163533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:23.163971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:23.164706 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:23.165165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:23.165580 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:23.385442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:23.395426 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-46e06603-9cbe-4238-9e47-1f36043922be tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1362 microversion: 2.1 time: 0.244955 Sep 23 15:26:23.409358 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 408/847] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:23 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:24.423927 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:24.424695 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:24.439581 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:24.440365 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:24.441058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:24.441868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:24.442392 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:24.443010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:24.680877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:24.690192 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-53004732-e023-414b-8448-9a4b43dda246 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1547 microversion: 2.1 time: 0.274381 Sep 23 15:26:24.691754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 440/848] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:24 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1547 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:24.718502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:24.719143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:24.726254 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:24.727083 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:24.727750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:24.728997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:24.729669 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:24.730731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:24.880940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-970ed5d1-7283-4f18-a798-18547e875e9d tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167154 Sep 23 15:26:24.889194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 409/849] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Sep 23 15:26:24 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:26.103541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2852e239-e954-42e8-919e-c9c669b1921b tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Action: 'create', calling method: .version_select at 0x7fbb02f02ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1840713881", "metadata": {"Type": "work"}}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:26.158479 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-dd5d3a91-aeeb-489d-bc45-ed7dc8d97ad6 req-e11db519-001d-4af4-a6b5-e7f80fda47bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b9f1d7-4143-4d97-af21-d148c232a438", "tag": "75e7bdc4-43db-4f8f-878c-111d10f4749a"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:26.168072 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-dd5d3a91-aeeb-489d-bc45-ed7dc8d97ad6 req-e11db519-001d-4af4-a6b5-e7f80fda47bc service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:26.168697 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-dd5d3a91-aeeb-489d-bc45-ed7dc8d97ad6 req-e11db519-001d-4af4-a6b5-e7f80fda47bc service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:26.169233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-dd5d3a91-aeeb-489d-bc45-ed7dc8d97ad6 req-e11db519-001d-4af4-a6b5-e7f80fda47bc service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:26.181512 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-dd5d3a91-aeeb-489d-bc45-ed7dc8d97ad6 req-e11db519-001d-4af4-a6b5-e7f80fda47bc service nova] Creating event network-changed:75e7bdc4-43db-4f8f-878c-111d10f4749a for instance 21b9f1d7-4143-4d97-af21-d148c232a438 on hv-cinder-85501 Sep 23 15:26:26.186900 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-dd5d3a91-aeeb-489d-bc45-ed7dc8d97ad6 req-e11db519-001d-4af4-a6b5-e7f80fda47bc service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Sep 23 15:26:26.187684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 410/850] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:26.446535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2852e239-e954-42e8-919e-c9c669b1921b tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.463981 Sep 23 15:26:26.447162 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 441/851] 10.222.0.75 () {60 vars in 1156 bytes} [Fri Sep 23 15:26:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 15:26:26.464355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b0427f4a-3693-47e0-a4ac-b65fda247efa tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Calling method '.version_select at 0x7fbb02f61700>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:26.526825 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b0427f4a-3693-47e0-a4ac-b65fda247efa tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff" status: 200 len: 353 microversion: 2.1 time: 0.069153 Sep 23 15:26:26.528653 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 411/852] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:26 2022] GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:27.548420 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-afc9bf80-8f65-4bf8-8bb3-cb3cedeb9192 tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Calling method '.version_select at 0x7fbb02fba430>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:27.608367 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-afc9bf80-8f65-4bf8-8bb3-cb3cedeb9192 tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff" status: 200 len: 354 microversion: 2.1 time: 0.068513 Sep 23 15:26:27.608980 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 442/853] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:27 2022] GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:27.622918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5a8a8662-b277-42a2-b128-881407936c1c tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Calling method '.version_select at 0x7fbb02f89ca0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:27.673939 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5a8a8662-b277-42a2-b128-881407936c1c tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff" status: 200 len: 354 microversion: 2.1 time: 0.055392 Sep 23 15:26:27.674749 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 412/854] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:27 2022] GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:27.695651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2384a5f1-9fc6-4c51-bbb0-b398f62d0993 tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Calling method '.version_select at 0x7fbb02ef30d0>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:27.763558 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2384a5f1-9fc6-4c51-bbb0-b398f62d0993 tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff" status: 202 len: 0 microversion: 2.1 time: 0.071685 Sep 23 15:26:27.764295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 443/855] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:26:27 2022] DELETE /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:26:27.772378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bb7c9e62-4ce0-49bc-be0c-f1e86e002bec tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Calling method '.version_select at 0x7fbb02f89040>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:27.822851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bb7c9e62-4ce0-49bc-be0c-f1e86e002bec tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff" status: 200 len: 353 microversion: 2.1 time: 0.053945 Sep 23 15:26:27.823731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 413/856] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:27 2022] GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:28.842451 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5f6c4f32-5052-42c0-9705-3764a1e88f2a tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Calling method '.version_select at 0x7fbb02f02c10>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:28.882418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-5f6c4f32-5052-42c0-9705-3764a1e88f2a tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] HTTP exception thrown: Volume 2fff541c-a669-4cd1-a2a3-68193ffe3bff could not be found. Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5f6c4f32-5052-42c0-9705-3764a1e88f2a tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Request method failure captured: Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff HTTP/1.1 Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdAh1PRo6h3Ae_oRfCl8HHznHFpNvH_cSceV0n3kSJxJ3HZG2AFrIipz5smyQjtJ6Cb6YegscfjoxCt-y-dkC028LkJOsKyJEgYmVs3Co31k5sgzorcWwFHD2xudcMtwg5ZPp_aKDWuAFiHI21YiDsaTj9rsV6Y-wZzGTPHnHnu6wpg Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 7012146d99014fddb3d5a8c2e70a419e Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesGetTestJSON-1707427552 Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:26:28.885757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7012146d99014fddb3d5a8c2e70a419e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7012146d99014fddb3d5a8c2e70a419e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7012146d99014fddb3d5a8c2e70a419e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7012146d99014fddb3d5a8c2e70a419e"}]}] Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesGetTestJSON-1707427552 Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 7012146d99014fddb3d5a8c2e70a419e Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesGetTestJSON-1707427552 Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesGetTestJSON-1707427552-project Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 6dcfaaef5d344a1295ea2e60ba6a075a Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesGetTestJSON-1707427552-project Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Volume 2fff541c-a669-4cd1-a2a3-68193ffe3bff could not be found. Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '2fff541c-a669-4cd1-a2a3-68193ffe3bff'} Sep 23 15:26:28.887312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fff541c-a669-4cd1-a2a3-68193ffe3bff could not be found. (HTTP 404) (Request-ID: req-b1bad73e-ea17-464b-a1aa-463d1decef5b) Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:28.888751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:26:28.890226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fff541c-a669-4cd1-a2a3-68193ffe3bff could not be found. Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 15:26:28.891615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fff541c-a669-4cd1-a2a3-68193ffe3bff could not be found. Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fff541c-a669-4cd1-a2a3-68193ffe3bff could not be found. Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5f6c4f32-5052-42c0-9705-3764a1e88f2a tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] Returning 404 to user: Volume 2fff541c-a669-4cd1-a2a3-68193ffe3bff could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5f6c4f32-5052-42c0-9705-3764a1e88f2a tempest-VolumesGetTestJSON-1707427552 tempest-VolumesGetTestJSON-1707427552-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff" status: 404 len: 109 microversion: 2.1 time: 0.050343 Sep 23 15:26:28.893040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 444/857] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:26:28 2022] GET /compute/v2.1/os-volumes/2fff541c-a669-4cd1-a2a3-68193ffe3bff => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:46.874400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=16 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:46.875146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=28 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:46.880145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-995726381", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:46.934746 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] validate_networks() for None {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:26:47.238797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:26:47.239193 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:26:47.239679 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:26:47.240079 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:26:47.240482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:26:47.250214 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:47.250689 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:47.251118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:47.251852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:47.252283 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:47.252724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:47.269759 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Getting quotas for project 3c37b296273040cdb8c2a1281d91db03. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:26:47.273772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Getting quotas for user b423b3a26d7640fa8e23f104cfeaecd0 and project 3c37b296273040cdb8c2a1281d91db03. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:26:47.285429 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:26:47.288409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:26:47.334065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f8f30c60-d246-4eb9-8abc-14c5c23a11fa tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.461375 Sep 23 15:26:47.334734 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 414/858] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:26:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:26:47.344342 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=12 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:47.345136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:47.349708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-99982289-605d-49b3-b281-05596f053f96 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:47.350357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-99982289-605d-49b3-b281-05596f053f96 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:47.410694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-99982289-605d-49b3-b281-05596f053f96 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:47.417281 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-99982289-605d-49b3-b281-05596f053f96 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1214 microversion: 2.1 time: 0.075188 Sep 23 15:26:47.417848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 445/859] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:47 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:48.442913 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:48.443503 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:48.451522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:48.452010 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:48.452444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:48.453172 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:48.453625 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:48.454022 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:48.519503 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:48.528644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3bec929c-5c92-4514-b9b0-8a94cd94112f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1266 microversion: 2.1 time: 0.090031 Sep 23 15:26:48.529228 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 415/860] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:48 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:49.553814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:49.554433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:49.561711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:49.562421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:49.562856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:49.563547 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:49.564170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:49.564620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:49.795978 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:49.805453 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-82eadf67-05ff-4d8b-bce2-42c2a647ee6e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1314 microversion: 2.1 time: 0.255755 Sep 23 15:26:49.806104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 446/861] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:49 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:50.331474 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-62b3c7b1-1f99-45b7-bcd0-693f7f637270 req-4e81c7f4-7d88-4b25-bdcc-a56161efdf0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a11da25-c94e-428b-bf53-56c6cf76ba52", "tag": "c30f6ad3-d64f-4d7c-8fcd-6e8a7fe291a8"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:50.346937 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-62b3c7b1-1f99-45b7-bcd0-693f7f637270 req-4e81c7f4-7d88-4b25-bdcc-a56161efdf0e service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.347463 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-62b3c7b1-1f99-45b7-bcd0-693f7f637270 req-4e81c7f4-7d88-4b25-bdcc-a56161efdf0e service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.347891 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-62b3c7b1-1f99-45b7-bcd0-693f7f637270 req-4e81c7f4-7d88-4b25-bdcc-a56161efdf0e service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.362547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-62b3c7b1-1f99-45b7-bcd0-693f7f637270 req-4e81c7f4-7d88-4b25-bdcc-a56161efdf0e service nova] Creating event network-changed:c30f6ad3-d64f-4d7c-8fcd-6e8a7fe291a8 for instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 on hv-cinder-85501 Sep 23 15:26:50.370324 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-62b3c7b1-1f99-45b7-bcd0-693f7f637270 req-4e81c7f4-7d88-4b25-bdcc-a56161efdf0e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055214 Sep 23 15:26:50.370945 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 416/862] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:26:50.676773 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:50.677657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-87d84a9f-e58e-4403-af41-0ad79cb6cd25 req-f51dc40f-894e-4879-9eb2-ee5777fd6d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0a3e47-96a7-461b-81dc-e879cf1df317", "tag": "aa222fb4-42c6-4891-beb9-013184d89cc9"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:50.678384 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:50.687389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.687740 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.688354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.689156 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.689606 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.690040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.700838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-87d84a9f-e58e-4403-af41-0ad79cb6cd25 req-f51dc40f-894e-4879-9eb2-ee5777fd6d62 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.701435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-87d84a9f-e58e-4403-af41-0ad79cb6cd25 req-f51dc40f-894e-4879-9eb2-ee5777fd6d62 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.701930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-87d84a9f-e58e-4403-af41-0ad79cb6cd25 req-f51dc40f-894e-4879-9eb2-ee5777fd6d62 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.716067 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-87d84a9f-e58e-4403-af41-0ad79cb6cd25 req-f51dc40f-894e-4879-9eb2-ee5777fd6d62 service nova] Creating event network-changed:aa222fb4-42c6-4891-beb9-013184d89cc9 for instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 on hv-cinder-85501 Sep 23 15:26:50.721188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:26:50.722241 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-87d84a9f-e58e-4403-af41-0ad79cb6cd25 req-f51dc40f-894e-4879-9eb2-ee5777fd6d62 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048672 Sep 23 15:26:50.727289 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 417/863] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:50.817246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5f882193-b029-4c05-867c-fe37ea5eba45 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 204 len: 0 microversion: 2.1 time: 0.145829 Sep 23 15:26:50.818432 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 447/864] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:26:50 2022] DELETE /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:26:50.828429 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:50.829537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:50.837382 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.839163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.839878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.841081 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.841707 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.842374 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.842463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:50.843387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:50.850289 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.851005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.851446 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.852162 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:50.852640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:50.853075 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:50.988872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:50.995478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:50.997543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-61f92ac7-3ca1-4247-8201-87f7cc220e68 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.174718 Sep 23 15:26:50.998329 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 418/865] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:50 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:26:51.003889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ef70c7f0-c2c9-47fa-a8eb-5645bfea03fb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1314 microversion: 2.1 time: 0.169046 Sep 23 15:26:51.004450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 448/866] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:50 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:52.023509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:52.024031 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:52.027453 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:52.028069 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:52.031231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.031751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.032184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.032922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.033357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.033771 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.034911 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.035393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.035830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.037114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:52.037570 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:52.037997 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:52.177031 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:52.182943 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:52.186744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3772431c-e27f-4a95-82f7-a7d84188fe55 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.168036 Sep 23 15:26:52.187331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 419/867] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:52 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:52.190689 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9eba8637-908e-418b-9859-7b60d8ac30ae tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1314 microversion: 2.1 time: 0.167131 Sep 23 15:26:52.191239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 449/868] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:52 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:53.210593 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:53.211248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:53.213822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:53.214425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:53.217859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:53.218336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:53.218768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:53.219460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:53.219911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:53.220333 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:53.221293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:53.221774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:53.222203 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:53.222895 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:53.223330 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:53.223861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:53.356902 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:53.362188 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:53.365527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e63f92f1-56a6-4308-83fc-0ac3519adffb tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1314 microversion: 2.1 time: 0.155640 Sep 23 15:26:53.366108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 450/869] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:53 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:53.370860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a327dbaf-5fc7-4899-840c-f0f72059431c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.164079 Sep 23 15:26:53.384962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 420/870] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:53 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:54.391506 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:54.393521 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:54.395738 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:54.396487 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:54.403610 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:54.404326 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:54.404422 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:54.404513 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:54.404769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:54.405476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:54.406024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:54.406486 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:54.407296 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:54.408042 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:54.410201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:54.412074 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:54.571550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:54.578176 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:54.581318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4a2e444c-31fa-48f8-bb6f-be1cb5aeea6a tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1566 microversion: 2.1 time: 0.189811 Sep 23 15:26:54.582157 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 421/871] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:54 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:54.586942 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-52bfefa8-6ae8-4e1a-b495-6b38cda59e57 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1314 microversion: 2.1 time: 0.200704 Sep 23 15:26:54.587110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-ef26b339-f836-42d7-ac49-5bb0b9f5fc55 req-4ae582a1-b80f-4ae3-8d85-b04d75f3c083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a11da25-c94e-428b-bf53-56c6cf76ba52", "name": "network-vif-plugged", "status": "completed", "tag": "c30f6ad3-d64f-4d7c-8fcd-6e8a7fe291a8"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:54.589922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 451/872] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:54 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:54.597151 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-ef26b339-f836-42d7-ac49-5bb0b9f5fc55 req-4ae582a1-b80f-4ae3-8d85-b04d75f3c083 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:54.597797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-ef26b339-f836-42d7-ac49-5bb0b9f5fc55 req-4ae582a1-b80f-4ae3-8d85-b04d75f3c083 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:54.598299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-ef26b339-f836-42d7-ac49-5bb0b9f5fc55 req-4ae582a1-b80f-4ae3-8d85-b04d75f3c083 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:54.609500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-ef26b339-f836-42d7-ac49-5bb0b9f5fc55 req-4ae582a1-b80f-4ae3-8d85-b04d75f3c083 service nova] Creating event network-vif-plugged:c30f6ad3-d64f-4d7c-8fcd-6e8a7fe291a8 for instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 on hv-cinder-85501 Sep 23 15:26:54.614564 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-ef26b339-f836-42d7-ac49-5bb0b9f5fc55 req-4ae582a1-b80f-4ae3-8d85-b04d75f3c083 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 Sep 23 15:26:54.615158 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 422/873] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:55.571651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-5538aa66-d363-4250-a354-fd527fad82c2 req-8469729c-cf13-4fee-9f55-88d05970c97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0a3e47-96a7-461b-81dc-e879cf1df317", "name": "network-vif-deleted", "tag": "aa222fb4-42c6-4891-beb9-013184d89cc9"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:55.581997 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5538aa66-d363-4250-a354-fd527fad82c2 req-8469729c-cf13-4fee-9f55-88d05970c97b service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.582462 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5538aa66-d363-4250-a354-fd527fad82c2 req-8469729c-cf13-4fee-9f55-88d05970c97b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.582881 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-5538aa66-d363-4250-a354-fd527fad82c2 req-8469729c-cf13-4fee-9f55-88d05970c97b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.596354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-5538aa66-d363-4250-a354-fd527fad82c2 req-8469729c-cf13-4fee-9f55-88d05970c97b service nova] Creating event network-vif-deleted:aa222fb4-42c6-4891-beb9-013184d89cc9 for instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 on hv-cinder-85501 Sep 23 15:26:55.603035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-5538aa66-d363-4250-a354-fd527fad82c2 req-8469729c-cf13-4fee-9f55-88d05970c97b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 Sep 23 15:26:55.603810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 452/874] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:26:55.607260 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:55.607736 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:55.613528 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:55.613913 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.614367 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:55.614485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.614818 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.615502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.615952 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.616648 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.623043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.624631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.625071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.625875 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:55.626909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:55.627344 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:55.693027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:55.701112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3d86e5f3-ecdf-4d38-8cb1-d73fe26880c8 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1381 microversion: 2.1 time: 0.099192 Sep 23 15:26:55.701686 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 423/875] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:55 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1381 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:26:55.777484 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:55.785253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9602ce5b-aa75-42df-9748-db25767b400e tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1314 microversion: 2.1 time: 0.175824 Sep 23 15:26:55.785754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 453/876] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:55 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:56.726759 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:56.727703 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:56.736942 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:56.737505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:56.738083 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:56.738992 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:56.739598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:56.740194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:56.804443 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3077d51be16e40d9bb70b984583c0f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592a763d7123405fb0576b00edfcd1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:56.809167 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:56.809781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:56.812623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ec01996f-331c-4f2d-aff7-3a7a21708653 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 200 len: 1219 microversion: 2.1 time: 0.091183 Sep 23 15:26:56.813206 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 424/877] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:56 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:56.816637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:56.817123 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:56.817551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:56.818244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:56.818685 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:56.819099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:56.963873 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:56.972607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a40fcace-3b84-4faf-b144-e5efe8d2dcda tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1314 microversion: 2.1 time: 0.167106 Sep 23 15:26:56.973186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 454/878] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:56 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:57.680291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:57.680815 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:57.683535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:57.684203 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:57.690398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:57.690885 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:57.691341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:57.692383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:57.692491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:57.692900 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:57.717246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-82a58165-49be-48a7-b641-a5014a70cbec tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/ips" status: 200 len: 153 microversion: 2.20 time: 0.040926 Sep 23 15:26:57.717938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 425/879] 10.222.0.75 () {60 vars in 1289 bytes} [Fri Sep 23 15:26:57 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:26:57.836251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:57.837650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] [instance: 9a0a3e47-96a7-461b-81dc-e879cf1df317] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:57.839807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:57.845653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:57.846145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:57.846584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:57.847317 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:57.847772 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:57.848386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:57.862536 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] HTTP exception thrown: Instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 could not be found. Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Request method failure captured: Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 HTTP/1.1 Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc6vjFYCWqe8tTjQHxrEgqfsH6UCgXMJHn5mLITN-SSul5Q0kRz3kFjmWwhhmMVf7zHYFBoLw5-nNdOicI3iY80iqMoe3ywLjjht_AeBTmV9KdvGIWgrppe7WeP5uHgi_DwjKqx2X4PvXKlQcGRnf8O-kx2AmYmurcuyPChvLIPepgo Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 592a763d7123405fb0576b00edfcd1bf Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-TestShelveInstance-648048747 Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:26:57.864173 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/592a763d7123405fb0576b00edfcd1bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_592a763d7123405fb0576b00edfcd1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/592a763d7123405fb0576b00edfcd1bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/592a763d7123405fb0576b00edfcd1bf"}]}] Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-TestShelveInstance-648048747 Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 592a763d7123405fb0576b00edfcd1bf Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-TestShelveInstance-648048747 Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-TestShelveInstance-648048747-project Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 3077d51be16e40d9bb70b984583c0f8a Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-TestShelveInstance-648048747-project Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 could not be found. Sep 23 15:26:57.865700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '9a0a3e47-96a7-461b-81dc-e879cf1df317'} Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 could not be found. Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:26:57.867118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 could not be found. Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 could not be found. Sep 23 15:26:57.869429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:26:57.872421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Returning 404 to user: Instance 9a0a3e47-96a7-461b-81dc-e879cf1df317 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:26:57.872421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ac94746b-1928-47d0-ac7b-59f2f4a2ec4c tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317" status: 404 len: 111 microversion: 2.1 time: 0.033372 Sep 23 15:26:57.872421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 455/880] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:57 2022] GET /compute/v2.1/servers/9a0a3e47-96a7-461b-81dc-e879cf1df317 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:26:57.997620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:57.998283 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:58.009005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:58.009005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:58.009005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:58.009005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:58.009381 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:58.009381 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:58.043764 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7aca8387-353f-494f-9cc6-482d1640a122 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] Calling method '.version_select at 0x7fbb06846e50>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:58.067782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7aca8387-353f-494f-9cc6-482d1640a122 tempest-TestShelveInstance-648048747 tempest-TestShelveInstance-648048747-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1358845633" status: 202 len: 0 microversion: 2.1 time: 0.028517 Sep 23 15:26:58.074087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 456/881] 10.222.0.75 () {58 vars in 1254 bytes} [Fri Sep 23 15:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1358845633 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:26:58.178849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:58.186759 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d8ae8c0b-7975-4342-a912-4761fcce673b tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1464 microversion: 2.1 time: 0.193950 Sep 23 15:26:58.187339 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 426/882] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:57 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1464 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:58.234202 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:58.234624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:58.243654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:58.244146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:58.244738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:58.245447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:58.245904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:58.246326 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:58.271806 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:26:58.354261 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-025afcc4-24d3-4f6d-a279-0f884cdb38f8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 204 len: 0 microversion: 2.1 time: 0.123817 Sep 23 15:26:58.355210 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 457/883] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:26:58 2022] DELETE /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:26:58.363780 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:58.364669 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:58.370827 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:58.371388 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:58.372366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:58.373104 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:58.373558 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:58.374066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:58.509463 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:58.518438 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cd555fee-8a99-47a9-8767-1fc156d03cc8 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1470 microversion: 2.1 time: 0.158610 Sep 23 15:26:58.519138 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 427/884] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:58 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:26:59.543268 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:26:59.543930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:59.551527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:59.552042 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:59.552470 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:59.553198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:59.553645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:59.554061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:59.750053 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:26:59.750621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:26:59.758599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:59.759085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:59.759751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:59.760450 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:26:59.760930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:26:59.761559 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:26:59.786886 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lazy-loading 'flavor' on Instance uuid 37411fb8-ca8b-42de-850e-3ca0d9c9d615 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:26:59.808488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:26:59.822358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d083ae1f-8f5c-4d13-830c-f94e4ce2b06f tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1470 microversion: 2.1 time: 0.283407 Sep 23 15:26:59.823986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 458/885] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:26:59 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:00.022578 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9ce805a9-80a2-49d7-8af3-f79f6a9fa343 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/action" status: 202 len: 0 microversion: 2.20 time: 0.276641 Sep 23 15:27:00.032266 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:00.033153 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:00.038645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 428/886] 10.222.0.75 () {62 vars in 1319 bytes} [Fri Sep 23 15:26:59 2022] POST /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:27:00.040324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:00.041184 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:00.041807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:00.042505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:00.042952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:00.043368 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:00.242475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:00.251977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:00.253425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:00.254751 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1083a374-d7ff-4f98-b9a0-254083b33aef tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.226769 Sep 23 15:27:00.264789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 459/887] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:00 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:00.665624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-547ec106-3e7f-4bc7-a545-19671ad75202 req-db99ed27-65a4-4193-92e2-bffac4f39fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a11da25-c94e-428b-bf53-56c6cf76ba52", "name": "network-vif-deleted", "tag": "c30f6ad3-d64f-4d7c-8fcd-6e8a7fe291a8"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:00.677368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-547ec106-3e7f-4bc7-a545-19671ad75202 req-db99ed27-65a4-4193-92e2-bffac4f39fe0 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:00.677950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-547ec106-3e7f-4bc7-a545-19671ad75202 req-db99ed27-65a4-4193-92e2-bffac4f39fe0 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:00.678448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-547ec106-3e7f-4bc7-a545-19671ad75202 req-db99ed27-65a4-4193-92e2-bffac4f39fe0 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:00.695640 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-547ec106-3e7f-4bc7-a545-19671ad75202 req-db99ed27-65a4-4193-92e2-bffac4f39fe0 service nova] Creating event network-vif-deleted:c30f6ad3-d64f-4d7c-8fcd-6e8a7fe291a8 for instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 on hv-cinder-85501 Sep 23 15:27:00.706934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-547ec106-3e7f-4bc7-a545-19671ad75202 req-db99ed27-65a4-4193-92e2-bffac4f39fe0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045050 Sep 23 15:27:00.708000 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 429/888] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:00.846198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:00.846817 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:00.854439 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:00.855262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:00.855646 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:00.856349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:00.856823 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:00.857269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:00.891856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:00.892369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:00.892823 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:00.893248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lazy-loading 'fault' on Instance uuid 5a11da25-c94e-428b-bf53-56c6cf76ba52 {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:27:00.943272 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423b3a26d7640fa8e23f104cfeaecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c37b296273040cdb8c2a1281d91db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:00.961448 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-636d4338-608b-4fbd-9ac2-a7cb4957bc22 tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 200 len: 1304 microversion: 2.1 time: 0.119039 Sep 23 15:27:00.968062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 460/889] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:00 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:01.282572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:01.283276 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:01.290687 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:01.291448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:01.292055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:01.295772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:01.296256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:01.296733 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:01.458404 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:01.469361 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:01.472122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:01.473989 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fcd57fb1-a4be-4064-b9e4-c20b4f1b086d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.195780 Sep 23 15:27:01.474872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 430/890] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:01 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:01.985809 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:01.986607 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] [instance: 5a11da25-c94e-428b-bf53-56c6cf76ba52] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:01.993333 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:01.993997 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:01.994466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:01.995232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:01.995698 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:01.996125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:02.001657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:02.011357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] HTTP exception thrown: Instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 could not be found. Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Request method failure captured: Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 HTTP/1.1 Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdA1q3YQpbdlMsd6ZY4UGL9oR3jj6HcRuJbd-bsY6yXEYGt6dsGwJc3kHrA1U2FXv3_CBHl4Nc3PMGc-TzQAjRKXAcm4FR3bl7b9tZU-iD4CdJQVuQ2-QS3h4naWmUc7Mwnf4IbfiKXW3JwInNP41PMtHypIJpvtShruI5WiGa1JdkM Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 3c37b296273040cdb8c2a1281d91db03 Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesNegativeTest-1796457817 Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:27:02.013040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c37b296273040cdb8c2a1281d91db03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3c37b296273040cdb8c2a1281d91db03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c37b296273040cdb8c2a1281d91db03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3c37b296273040cdb8c2a1281d91db03"}]}] Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesNegativeTest-1796457817 Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 3c37b296273040cdb8c2a1281d91db03 Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesNegativeTest-1796457817 Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesNegativeTest-1796457817-project Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: b423b3a26d7640fa8e23f104cfeaecd0 Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesNegativeTest-1796457817-project Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 could not be found. Sep 23 15:27:02.014440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '5a11da25-c94e-428b-bf53-56c6cf76ba52'} Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 could not be found. Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:27:02.015236 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 could not be found. Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 could not be found. Sep 23 15:27:02.016563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:27:02.017734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] Returning 404 to user: Instance 5a11da25-c94e-428b-bf53-56c6cf76ba52 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:27:02.017734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-64db278c-29c3-40a5-85b6-fd8a40bdbefd tempest-VolumesNegativeTest-1796457817 tempest-VolumesNegativeTest-1796457817-project] 10.222.0.75 "GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52" status: 404 len: 111 microversion: 2.1 time: 0.033169 Sep 23 15:27:02.017734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 461/891] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:01 2022] GET /compute/v2.1/servers/5a11da25-c94e-428b-bf53-56c6cf76ba52 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:27:02.503840 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:02.505250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:02.512505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:02.513079 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:02.513878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:02.514787 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:02.515400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:02.515985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:02.718529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:02.726999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:02.728958 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:02.730468 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5302827d-4a1b-455a-9cc0-c7f32e887d09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.234733 Sep 23 15:27:02.745456 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 431/892] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:02 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:27:03.765775 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:03.769352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:03.786994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:03.788526 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:03.789150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:03.790958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:03.792110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:03.792543 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:04.031638 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:04.044329 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:04.046089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:04.047272 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d9c42c7f-cb5b-4c32-9a4f-7a3399816c6f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.294151 Sep 23 15:27:04.056973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 462/893] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:03 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:05.079493 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:05.080907 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:05.107297 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:05.108503 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:05.109531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:05.110386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:05.111809 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:05.111914 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:05.122168 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:05.260054 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:05.268637 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:05.270109 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:05.271299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-426ba787-f588-4fa3-b437-f842c2c3b0a1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.196360 Sep 23 15:27:05.271857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 432/894] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:05 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:06.297969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:06.298861 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:06.306899 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:06.307494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:06.307998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:06.308986 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:06.309518 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:06.310425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:06.456564 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:06.464921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:06.466355 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:06.467738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-633b9435-4fc9-4134-9625-39eb7255d5b8 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.174256 Sep 23 15:27:06.468287 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 463/895] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:06 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:07.495257 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:07.496436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:07.503403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:07.504158 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:07.504611 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:07.505331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:07.505785 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:07.506216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:07.648841 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:07.657420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:07.658926 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:07.660095 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-77c1b9eb-6197-4927-acbc-2d09beab8378 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.169077 Sep 23 15:27:07.660677 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 433/896] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:07 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:08.686714 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:08.687324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:08.693931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:08.694422 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:08.694860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:08.695602 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:08.696057 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:08.696494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:08.835213 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:08.844198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:08.845683 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:08.846990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4a504a90-251e-48e7-8e90-5e644ae2f446 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.164744 Sep 23 15:27:08.847736 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 464/897] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:08 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:09.875302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:09.877660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:09.887829 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:09.889938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:09.890946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:09.892468 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:09.893338 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:09.894052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:10.052220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:10.060911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:10.062362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:10.063580 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-df06f709-3a51-4988-855a-8a80fa357bce tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.193566 Sep 23 15:27:10.064147 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 434/898] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:09 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:11.091501 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:11.093122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:11.100760 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:11.101325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:11.101830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:11.102609 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:11.103185 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:11.103684 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:11.314395 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:11.324160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:11.325764 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:11.327119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-107fd17a-23ca-45a7-a189-083335c7602c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.240285 Sep 23 15:27:11.329619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 465/899] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:11 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:27:12.354068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:12.354861 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:12.361986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.362623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.363062 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.363795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:12.364341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:12.364847 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:12.583167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:12.597897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:12.599543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:12.600928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dfcd009d-0e79-4768-ae4d-2affcc260aa5 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.251000 Sep 23 15:27:12.601882 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 435/900] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:12 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:13.632000 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:13.632869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:13.642552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:13.643622 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:13.644440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:13.645405 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:13.645920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:13.646901 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:13.884580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:13.898733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:13.904414 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:13.906328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-71d262b3-28cb-43b9-8fa6-099f639fee9e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.283185 Sep 23 15:27:13.911611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 466/901] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:13 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:14.938689 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:14.940275 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:14.949995 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:14.950741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:14.951387 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:14.953738 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:14.954419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:14.955185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:15.208138 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:15.217673 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:15.218535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:15.219902 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5a61afe2-9251-4575-805c-55f623338637 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.286983 Sep 23 15:27:15.221011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 436/902] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:14 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:16.249037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:16.249804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:16.259074 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:16.260180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:16.261046 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:16.261929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:16.262524 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:16.263047 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:16.429286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:16.453295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:16.458581 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:16.458581 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5166a479-fdac-43ad-a742-ae12ee54c161 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.215243 Sep 23 15:27:16.461921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 467/903] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:16 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:17.080038 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b09e166c-4db3-4204-8904-837146371e9f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Action: 'create', calling method: .version_select at 0x7fbb02c5c160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1827241209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKs/ue785ib5gIvpb+UTqNfDujnaBBLJELPy42koQxnukEK9O1AQLXuYTkPeQw+3Zc86kFJ7o/LE0ikbofBKmUkG+cNL3cdRjedxwLA1fRCSdY+tiAWnuMvCiYHVzKUNdQ=="}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:17.085570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:17.102406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-b09e166c-4db3-4204-8904-837146371e9f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Getting quotas for project c05aa308acb842198935488c659d9ab3. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:27:17.107473 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-b09e166c-4db3-4204-8904-837146371e9f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Getting quotas for user cd5b918b0427408d9a70ca568d75ad58 and project c05aa308acb842198935488c659d9ab3. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:27:17.138122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b09e166c-4db3-4204-8904-837146371e9f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.240553 Sep 23 15:27:17.138733 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 437/904] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:27:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:17.489063 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:17.490314 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:17.497793 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:17.499541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.500614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.501211 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.502242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:17.503230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:17.503851 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:17.742365 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:17.758401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:17.759849 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:17.761425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-28cadc73-e74f-49b9-80af-35ca769b665e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1746 microversion: 2.20 time: 0.277227 Sep 23 15:27:17.762152 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 468/905] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:17 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1746 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:18.789030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:18.789614 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:18.802122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:18.802888 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:18.803446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:18.804407 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:18.805111 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:18.805736 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:19.003946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:19.013793 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:19.015650 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:19.016848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b21dba0a-4d1f-4bd7-9aa9-78728a64f84c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1746 microversion: 2.20 time: 0.233353 Sep 23 15:27:19.017586 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 438/906] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:18 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1746 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:20.042923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:20.044365 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:20.051641 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.052464 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.053822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:20.054997 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.055864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.056522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:20.202904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:20.211358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:20.213160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:20.214456 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6cace078-f7dd-4d6e-918c-14bd8764ba6c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1746 microversion: 2.20 time: 0.175992 Sep 23 15:27:20.215015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 469/907] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:20 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:20.824498 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-d71d07bc-8366-4e83-adeb-e744d68ed462 req-e95b7702-fff3-4418-b2fd-7047acf930f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37411fb8-ca8b-42de-850e-3ca0d9c9d615", "name": "network-vif-plugged", "status": "completed", "tag": "5ce0bfbd-c402-457c-b397-3abfbebd324a"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:20.835252 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d71d07bc-8366-4e83-adeb-e744d68ed462 req-e95b7702-fff3-4418-b2fd-7047acf930f0 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:20.836015 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d71d07bc-8366-4e83-adeb-e744d68ed462 req-e95b7702-fff3-4418-b2fd-7047acf930f0 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:20.837448 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-d71d07bc-8366-4e83-adeb-e744d68ed462 req-e95b7702-fff3-4418-b2fd-7047acf930f0 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:20.851198 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-d71d07bc-8366-4e83-adeb-e744d68ed462 req-e95b7702-fff3-4418-b2fd-7047acf930f0 service nova] Creating event network-vif-plugged:5ce0bfbd-c402-457c-b397-3abfbebd324a for instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 on hv-cinder-85501 Sep 23 15:27:20.856495 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-d71d07bc-8366-4e83-adeb-e744d68ed462 req-e95b7702-fff3-4418-b2fd-7047acf930f0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035970 Sep 23 15:27:20.857152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 439/908] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:27:21.239616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:21.240372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:21.248381 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:21.249005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:21.249621 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:21.251357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:21.251814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:21.252238 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:21.409659 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:21.418977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:21.420423 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:21.421676 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8e63a4f0-2354-4515-b234-1a2ba36080e6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1746 microversion: 2.20 time: 0.185990 Sep 23 15:27:21.434730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 470/909] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:21 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1746 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:22.448139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:22.448878 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:22.455575 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:22.456012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:22.456444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:22.457176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:22.457626 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:22.458047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:22.627602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:22.636905 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:22.638539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:22.640096 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-488d2998-face-4de6-995f-8c48e933ac9f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.196900 Sep 23 15:27:22.640780 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 440/910] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:22 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:23.666643 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:23.667956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:23.676131 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:23.676649 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:23.677090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:23.677797 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:23.678426 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:23.679029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:23.825559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:23.835225 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:23.836740 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:23.837923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-42501738-f394-44ee-9126-1b741bcc5e8d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.175354 Sep 23 15:27:23.838476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 471/911] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:23 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:24.864426 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:24.865088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:24.873588 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:24.874094 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:24.874530 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:24.875276 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:24.875726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:24.876149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:25.025142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:25.036307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:25.038099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:25.039980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f006fca4-6db1-41b9-8c8e-526e43733937 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.180292 Sep 23 15:27:25.040747 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 441/912] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:24 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:26.066672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:26.067514 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:26.074091 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:26.078018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:26.078525 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:26.079343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:26.079873 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:26.080369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:26.232453 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:26.256411 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:26.258120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:26.259634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a6e51142-6d49-409e-9ea4-b7d47a20c93d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.196960 Sep 23 15:27:26.260384 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 472/913] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:26 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:27.286134 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:27.293386 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:27.296429 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=4 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:27.304845 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:27.305447 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:27.305889 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:27.306597 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:27.307044 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:27.307464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:27.521129 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:27.531483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:27.539696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:27.546619 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6596dc75-f083-4eb1-9466-79ab965a4673 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.258923 Sep 23 15:27:27.550141 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 442/914] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:27 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:28.571573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:28.572286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:28.580624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:28.580949 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:28.581368 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:28.582118 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:28.582503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:28.582922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:28.738149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:28.747717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:28.749544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:28.750731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a2d38a65-4012-4c1a-82e8-9d42e050e5f4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.183183 Sep 23 15:27:28.751296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 473/915] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:28 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:29.780799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:29.781407 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:29.788450 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:29.788965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:29.789394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:29.790080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:29.790818 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:29.791450 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:29.930952 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:29.939234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:29.940682 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:29.941846 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c4f3288f-c7a9-4c70-a071-f4fdc7da3c5d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.165256 Sep 23 15:27:29.942384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 443/916] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:29 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:30.967992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:30.968638 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:30.976776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:30.977502 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:30.978014 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:30.978922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:30.979494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:30.980052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:31.123982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:31.132517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:31.134003 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:31.135125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e66034d4-c0a4-42f6-9c96-e697b781e89d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.171504 Sep 23 15:27:31.135683 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 474/917] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:30 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:32.161760 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:32.162595 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:32.170287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:32.170791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:32.171232 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:32.171957 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:32.172413 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:32.172872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:32.319549 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:32.328773 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:32.330227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:32.331408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d010858f-5137-46d7-b9bf-91c307cafa2f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.173744 Sep 23 15:27:32.331975 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 444/918] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:32 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:33.361995 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:33.363081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:33.374217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:33.374709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:33.375141 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:33.375841 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:33.376294 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:33.376835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:33.515750 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:33.524294 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:33.525788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:33.526950 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a18334df-8943-4f15-a38c-aaa1fc38f341 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.172409 Sep 23 15:27:33.527513 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 475/919] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:33 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:34.560231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:34.561160 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:34.569559 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:34.570365 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:34.571271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:34.572409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:34.572906 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:34.573414 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:34.738931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:34.751083 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:34.752533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:34.753763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fafccc41-e658-4655-a4e6-97a86681d9a0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1741 microversion: 2.20 time: 0.197889 Sep 23 15:27:34.754324 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 445/920] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:34 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:35.782687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:35.783550 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:35.792748 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:35.793485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:35.794082 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:35.795023 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:35.795862 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:35.796415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:35.799066 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=85 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:35.928253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:35.936847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:35.938285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:35.939466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3142153b-9aed-4e94-8dc6-72a74292d99f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1723 microversion: 2.20 time: 0.163110 Sep 23 15:27:35.940066 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 476/921] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:35 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:36.968849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:36.969457 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:36.976180 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:36.976696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:36.977137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:36.977838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:36.978296 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:36.978722 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:36.981369 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=73 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:37.112502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:37.121035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:37.122474 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:37.124161 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-caae8f00-1f5c-4af7-a878-fd14cd6a216d tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1723 microversion: 2.20 time: 0.161172 Sep 23 15:27:37.125005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 446/922] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:36 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:38.149090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:38.149724 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:38.156317 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:38.157025 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:38.157469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:38.158194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:38.158645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:38.159068 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:38.298579 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:38.311255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:38.313618 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:38.314780 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7b8036c0-6b35-4304-b546-988a8e4cb9b4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1666 microversion: 2.20 time: 0.169781 Sep 23 15:27:38.315337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 477/923] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:38 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1666 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:38.339486 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "614da622-3380-41da-90cf-6acd457d2040"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:38.341916 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:38.349348 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:38.349837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:38.350273 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:38.351054 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:38.351507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:38.351925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:38.660774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ca646ed8-c20f-4cf1-a7c5-3fed1caea7ab tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325115 Sep 23 15:27:38.661403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 447/924] 10.222.0.75 () {62 vars in 1364 bytes} [Fri Sep 23 15:27:38 2022] POST /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 15:27:38.781479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-324db1c5-ac81-4dd7-8c59-6652fe5aee79 req-b15051f9-c35f-429b-bed1-b0bd34d0a2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37411fb8-ca8b-42de-850e-3ca0d9c9d615", "name": "network-vif-unplugged", "status": "completed", "tag": "5ce0bfbd-c402-457c-b397-3abfbebd324a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:38.791385 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-324db1c5-ac81-4dd7-8c59-6652fe5aee79 req-b15051f9-c35f-429b-bed1-b0bd34d0a2a4 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:38.791909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-324db1c5-ac81-4dd7-8c59-6652fe5aee79 req-b15051f9-c35f-429b-bed1-b0bd34d0a2a4 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:38.792336 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-324db1c5-ac81-4dd7-8c59-6652fe5aee79 req-b15051f9-c35f-429b-bed1-b0bd34d0a2a4 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:38.798633 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:38.798633 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:38.804456 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:38.804663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.compute.server_external_events [req-324db1c5-ac81-4dd7-8c59-6652fe5aee79 req-b15051f9-c35f-429b-bed1-b0bd34d0a2a4 service nova] Unable to find a host for instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615. Dropping event network-vif-unplugged {{(pid=120918) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 15:27:38.805100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:38.805534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-324db1c5-ac81-4dd7-8c59-6652fe5aee79 req-b15051f9-c35f-429b-bed1-b0bd34d0a2a4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028105 Sep 23 15:27:38.805644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:38.806127 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 478/925] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 15:27:38.806449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:38.806969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:38.807446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:39.083912 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b1428245-0c63-42ea-abfd-36e79e483917 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "DELETE /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/os-volume_attachments/614da622-3380-41da-90cf-6acd457d2040" status: 202 len: 0 microversion: 2.20 time: 0.292975 Sep 23 15:27:39.084511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 448/926] 10.222.0.75 () {60 vars in 1457 bytes} [Fri Sep 23 15:27:38 2022] DELETE /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/os-volume_attachments/614da622-3380-41da-90cf-6acd457d2040 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:27:39.149108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:39.149733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:39.156163 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:39.156720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:39.157159 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:39.157848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:39.158299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:39.158717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:39.187908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120918) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 15:27:39.259402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e7e31d57-51b4-4112-b2be-24052b059998 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "POST /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/action" status: 202 len: 0 microversion: 2.20 time: 0.114343 Sep 23 15:27:39.260006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 479/927] 10.222.0.75 () {62 vars in 1319 bytes} [Fri Sep 23 15:27:39 2022] POST /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:27:39.268937 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:39.269795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:39.275912 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:39.276396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:39.276855 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:39.277715 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:39.278080 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:39.278633 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:39.412645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:39.421070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:39.422699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:39.423897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8eb364c0-c795-4aeb-a498-01c874275cb2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1674 microversion: 2.20 time: 0.159575 Sep 23 15:27:39.424461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 449/928] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:39 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:27:40.453624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:40.454193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:40.460811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:40.461293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:40.461719 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:40.462404 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:40.462850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:40.463265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:40.605375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:40.614295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:40.615733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:40.616948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a0e2ffb4-ab33-4a34-a20c-2c7e84940d4c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.171104 Sep 23 15:27:40.617486 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 480/929] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:40 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:41.360434 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-233963778", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1827241209", "security_groups": [{"name": "tempest-secgroup-smoke-132906259"}], "block_device_mapping_v2": [{"uuid": "1df14dd7-82cf-4559-b75f-9ec26af6051f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80722061-916e-4bee-90cb-3ac06c3dce58"}]}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:41.480574 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] validate_networks() for [('80722061-916e-4bee-90cb-3ac06c3dce58', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:27:41.644712 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:41.645577 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:41.659124 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:41.659981 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:41.660652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:41.661580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:41.662408 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:41.663188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:41.852832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:41.869262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:41.870845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:41.872284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c565f2cc-1b54-4064-be9f-db265b5ef289 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.232906 Sep 23 15:27:41.873387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 481/930] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:41 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 15:27:42.023495 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:27:42.024070 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:27:42.024607 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:27:42.025102 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:27:42.025778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:27:42.043457 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:42.044046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:42.044544 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:42.045373 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:42.045918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:42.046403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:42.065085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Getting quotas for project c05aa308acb842198935488c659d9ab3. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:27:42.070216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Getting quotas for user cd5b918b0427408d9a70ca568d75ad58 and project c05aa308acb842198935488c659d9ab3. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:27:42.132969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:27:42.135263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1df14dd7-82cf-4559-b75f-9ec26af6051f',volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:27:42.304001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-70d5e2cd-2b39-4736-a9e4-5f2aad010ebb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.947459 Sep 23 15:27:42.306131 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 450/931] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:27:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:27:42.318121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-db42b2ab-da73-4c1b-bb97-fcc3cdd8204d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:42.319094 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-db42b2ab-da73-4c1b-bb97-fcc3cdd8204d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:42.376815 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-db42b2ab-da73-4c1b-bb97-fcc3cdd8204d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:42.385117 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-db42b2ab-da73-4c1b-bb97-fcc3cdd8204d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1094 microversion: 2.1 time: 0.070750 Sep 23 15:27:42.394849 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 482/932] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:42 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:42.901039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:42.901800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:42.909001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:42.909484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:42.909911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:42.910601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:42.911048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:42.911462 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:43.064126 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:43.072720 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:43.074153 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:43.075321 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6cbad991-b7d4-44bc-b816-4a6867f273e4 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.179575 Sep 23 15:27:43.075880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 451/933] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:42 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:43.407661 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:43.408347 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:43.415637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:43.416371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:43.416826 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:43.417717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:43.418022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:43.418442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:43.484284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:43.493337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-980b623e-8df6-40c6-9218-5edec9c88c05 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.089736 Sep 23 15:27:43.493909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 483/934] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:43 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:44.101047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:44.101670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:44.108963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:44.121121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:44.121643 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:44.122407 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:44.123218 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:44.123624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:44.266944 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:44.275586 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:44.277058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:44.278236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5dd9c12a-cc98-400f-8cb8-4c8fc90ef89f tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.181283 Sep 23 15:27:44.278806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 452/935] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:44 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:44.515927 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:44.517356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:44.523919 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:44.524770 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:44.525420 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:44.526309 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:44.526768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:44.527193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:44.592672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:44.600728 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7f5295d1-a3ab-415d-994c-85f8d1ba6bdc tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.088726 Sep 23 15:27:44.601534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 484/936] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:44 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:45.304178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:45.304806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:45.312212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:45.312696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:45.313409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:45.314655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:45.315338 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:45.315760 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:45.458256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:45.466767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:45.468320 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:45.469641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-06bd5a44-2811-4ce8-9f11-957ad18243f1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.169399 Sep 23 15:27:45.470336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 453/937] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:45 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:45.625214 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:45.625926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:45.632979 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:45.633466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:45.633893 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:45.634609 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:45.635058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:45.635478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:45.704043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:45.712393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b4a859bd-984f-436f-88b2-b691c645254b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.091540 Sep 23 15:27:45.713029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 485/938] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:45 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:46.498574 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:46.499509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:46.507000 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:46.507490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:46.507924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:46.508622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:46.509112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:46.509539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:46.656998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:46.666313 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:46.667852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:46.669133 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-05fe464c-4331-4a41-8f37-a2306f94285c tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.175481 Sep 23 15:27:46.669914 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 454/939] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:46 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:46.735761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:46.736411 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:46.745048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:46.745759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:46.746382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:46.747274 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:46.748056 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:46.748479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:46.817457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:46.825330 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0958d0b3-2f12-4baf-8715-96c9d30cd551 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.093632 Sep 23 15:27:46.832860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 486/940] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:46 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:47.695446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:47.696085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:47.698373 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:47.704096 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:47.704807 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:47.705235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:47.705920 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:47.706366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:47.706781 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:47.848920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:47.849519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:47.852500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:47.856868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:47.858658 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:47.859435 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:47.862071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:47.863615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:47.864917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a0b40a78-6381-4adf-a527-b1c9331f07f0 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.173519 Sep 23 15:27:47.865681 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:47.874109 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:47.874566 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 455/941] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:47 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:47.875073 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:47.875732 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:47.948253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:47.956779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1ae7e2e6-20a6-4553-a88c-5c8e9d13aede tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.111779 Sep 23 15:27:47.957373 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 487/942] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:47 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:48.891837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:48.893355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:48.900968 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:48.901559 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:48.902107 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:48.903002 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:48.903575 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:48.904076 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:48.980312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:48.981896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:48.989524 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:48.991719 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:48.992994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:48.993922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:48.994574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:48.995015 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:49.046520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:49.056064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:49.057684 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:49.058969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b3f6e748-f6cc-495d-b269-154ce53dd87e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.171716 Sep 23 15:27:49.059106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:49.060656 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 456/943] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:48 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:49.067298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5e80b8c2-6035-421f-a0c7-257f0a33edad tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.091157 Sep 23 15:27:49.067877 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 488/944] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:48 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:50.088316 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:50.089002 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:50.090858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:50.091459 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:50.095893 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:50.096381 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:50.096954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:50.097936 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:50.098083 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:50.098535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:50.098682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:50.098964 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:50.099122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:50.099684 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:50.100128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:50.100548 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:50.163564 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:50.171931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-39ae6eb4-4eb5-48eb-be57-ee95c59e8a2e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.084858 Sep 23 15:27:50.172539 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 489/945] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:50 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:50.257801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:50.268979 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:50.271500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:50.273416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8a010bf6-d922-4a4d-8a27-cc3941ff5d36 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.189173 Sep 23 15:27:50.274176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 457/946] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:50 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:51.199961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:51.200968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:51.212237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:51.213082 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:51.213798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:51.214929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:51.215676 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:51.216371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:51.281619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:51.289574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-95289a53-94d9-4a13-a29a-b96b8384e087 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.096159 Sep 23 15:27:51.290139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 490/947] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:51 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:51.303226 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:51.303956 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:51.310860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:51.311348 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:51.311804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:51.312501 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:51.312990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:51.313412 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:51.317636 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:51.453378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:51.461614 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:51.463047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:51.464218 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4f808085-12da-4488-b586-75e3b34801dd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.165045 Sep 23 15:27:51.464838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 458/948] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:51 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:52.314982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:52.315568 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:52.322767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.323240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.323685 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.324376 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.324875 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.325289 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.381219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:52.389846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:52.397898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-249249e4-a402-4cff-a49f-4c34ac701a95 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.087073 Sep 23 15:27:52.398468 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 491/949] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:52 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:52.490661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:52.491165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:52.493104 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:52.493763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:52.500620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.501110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.501576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.502271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:52.502736 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:52.503216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:52.640534 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:52.648894 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:52.650324 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:52.651491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6acaf92f-920c-4d54-9fb8-f6979b0f8b33 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.165219 Sep 23 15:27:52.652049 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 459/950] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:52 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:53.081509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:53.082320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:53.089574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:53.090692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:53.091138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:53.091836 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:53.092291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:53.092754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:53.116279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-755501a5-577a-411e-a40a-8b8dcecdc92e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/ips" status: 200 len: 144 microversion: 2.1 time: 0.041375 Sep 23 15:27:53.116869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 492/951] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:27:53 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:53.421234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:53.422316 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:53.428475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:53.429065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:53.429569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:53.430435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:53.430959 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:53.431456 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:53.494584 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:53.503421 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-eef20d70-f2ce-48fa-b557-9cb3707726d7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.086234 Sep 23 15:27:53.503997 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 460/952] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:53 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:53.680297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:53.680965 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:53.688844 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:53.689413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:53.689920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:53.690729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:53.691263 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:53.691761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:53.830030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:53.832280 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:27:53.839866 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:53.841341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:53.842501 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3948f984-2d94-4767-b580-d1feea3a3aa6 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.168208 Sep 23 15:27:53.843058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 493/953] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:53 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:54.482714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0955cf5-bfa6-43eb-8ebe-e4fcf32b0325"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:54.485204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:54.492012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:54.492501 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:54.493022 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:54.493720 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:54.494163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:54.494585 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:54.526628 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:54.527243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:54.534532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:54.535073 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:54.535505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:54.536242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:54.536702 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:54.537339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:54.598984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:54.609348 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-784ebba6-f422-4957-a7d2-947ff68098e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.086368 Sep 23 15:27:54.610258 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 494/954] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:54 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:54.872856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:54.874302 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:54.884200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:54.884731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:54.885170 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:54.885870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:54.886328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:54.886753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:55.036047 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:55.049074 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:55.051449 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:55.053339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-65246ff8-4993-4df8-ada3-a2984bbf6012 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.187463 Sep 23 15:27:55.054151 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 495/955] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:54 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:55.646410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:55.647429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:55.658737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:55.659546 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:55.660267 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:55.661491 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:55.662306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:55.663089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:55.730349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:55.740811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-02305067-6070-4088-9187-9b5072a2c85c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1144 microversion: 2.1 time: 0.100950 Sep 23 15:27:55.741381 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 496/956] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:55 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:27:56.083342 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:56.084391 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:56.094530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.095342 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.096067 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.097269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.098034 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.098750 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.246996 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:56.269657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:56.271166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:56.272357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fe0969fd-52e4-4d53-bbfb-4509da1d5668 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.195638 Sep 23 15:27:56.272938 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 497/957] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:56 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:56.376204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2c214ed2-7c56-4b0d-8843-58ea9321a2f6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.897371 Sep 23 15:27:56.377134 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 461/958] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:27:54 2022] POST /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments => generated 194 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:56.769424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:56.770215 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:56.778979 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.779537 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.780006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.780786 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:56.781278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:56.781784 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:56.851322 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:56.860524 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fe68c46d-b143-4639-8213-618de3df622d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1192 microversion: 2.1 time: 0.098051 Sep 23 15:27:56.861136 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 498/959] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:56 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:57.300167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:57.300900 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:57.308178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:57.308701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:57.309144 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:57.309857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:57.310311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:57.310738 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:57.531061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:57.540633 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:57.541829 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:57.543065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fb36deeb-abd2-4d89-90b9-b7be538ee1fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.247455 Sep 23 15:27:57.543660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 462/960] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:57 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:57.884285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:57.884995 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:57.891957 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:57.892451 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:57.892939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:57.893644 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:57.894102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:57.894527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.028112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:58.035970 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4918ad75-acc4-441e-8a15-80214a51de98 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1277 microversion: 2.1 time: 0.155797 Sep 23 15:27:58.036528 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 499/961] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:57 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:58.452461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-57106069-2c69-4b2f-b1c6-4476bf952c1c req-72924fe1-4153-4313-beab-1680d8e10e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43e17d3-319f-4b57-ae94-39d418139c9c", "tag": "f0af20c2-28ed-4543-be12-2ae4069574a5"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:27:58.465604 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-57106069-2c69-4b2f-b1c6-4476bf952c1c req-72924fe1-4153-4313-beab-1680d8e10e48 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.466203 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-57106069-2c69-4b2f-b1c6-4476bf952c1c req-72924fe1-4153-4313-beab-1680d8e10e48 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.466718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-57106069-2c69-4b2f-b1c6-4476bf952c1c req-72924fe1-4153-4313-beab-1680d8e10e48 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.479644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-57106069-2c69-4b2f-b1c6-4476bf952c1c req-72924fe1-4153-4313-beab-1680d8e10e48 service nova] Creating event network-changed:f0af20c2-28ed-4543-be12-2ae4069574a5 for instance b43e17d3-319f-4b57-ae94-39d418139c9c on hv-cinder-85501 Sep 23 15:27:58.484863 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-57106069-2c69-4b2f-b1c6-4476bf952c1c req-72924fe1-4153-4313-beab-1680d8e10e48 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037147 Sep 23 15:27:58.485533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 463/962] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:27:58.567776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:58.568409 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:58.575776 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.576253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.576715 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.577408 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:58.577862 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:58.578281 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:58.828645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:58.837054 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:58.838880 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:58.840043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b8874a22-af25-4cc7-adeb-73046ff48396 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.276513 Sep 23 15:27:58.841066 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 500/963] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:58 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:27:59.060918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:59.061657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:59.068538 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:59.069071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:59.069490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:59.070200 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:59.070646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:59.071335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:59.288047 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:27:59.297142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3a6ccd61-98f5-45f5-99ab-9d061b20c61f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1277 microversion: 2.1 time: 0.241127 Sep 23 15:27:59.297907 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 464/964] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:27:59 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:27:59.871694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:27:59.872768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:27:59.883961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:59.884718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:59.885257 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:27:59.885954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:27:59.886403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:27:59.886821 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:00.040650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:00.049400 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:00.050838 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:00.052030 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-42e9ec3b-55b1-4ae4-b63e-35a7c95028bd tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.187513 Sep 23 15:28:00.052608 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 501/965] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:27:59 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:28:00.322590 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:00.323551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:00.332499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:00.333185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:00.333724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:00.334584 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:00.335183 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:00.335715 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:00.530435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:00.539027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c6389232-5e4e-45e3-8856-be099c74eb73 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1277 microversion: 2.1 time: 0.221333 Sep 23 15:28:00.539607 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 465/966] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:00 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:00.985046 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-e19172d7-ffda-4117-8ed0-f572375987ee req-78dd48f5-b88e-4553-9c41-87e9941fa018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37411fb8-ca8b-42de-850e-3ca0d9c9d615", "name": "network-vif-plugged", "status": "completed", "tag": "5ce0bfbd-c402-457c-b397-3abfbebd324a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:00.995735 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e19172d7-ffda-4117-8ed0-f572375987ee req-78dd48f5-b88e-4553-9c41-87e9941fa018 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:00.996218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e19172d7-ffda-4117-8ed0-f572375987ee req-78dd48f5-b88e-4553-9c41-87e9941fa018 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:00.996682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e19172d7-ffda-4117-8ed0-f572375987ee req-78dd48f5-b88e-4553-9c41-87e9941fa018 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.008040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-e19172d7-ffda-4117-8ed0-f572375987ee req-78dd48f5-b88e-4553-9c41-87e9941fa018 service nova] Creating event network-vif-plugged:5ce0bfbd-c402-457c-b397-3abfbebd324a for instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 on hv-cinder-85501 Sep 23 15:28:01.013458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-e19172d7-ffda-4117-8ed0-f572375987ee req-78dd48f5-b88e-4553-9c41-87e9941fa018 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032115 Sep 23 15:28:01.014045 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 502/967] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:01.078466 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:01.079274 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:01.086188 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:01.086670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:01.087099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.087784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:01.088228 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:01.088646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.232652 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:01.241189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:01.242633 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:01.243797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4e9c69c3-e585-4e1c-9a28-ba34175e90fa tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.169610 Sep 23 15:28:01.244357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 466/968] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:28:01 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:28:01.563673 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:01.564367 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:01.572128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:01.572630 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:01.573546 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.574369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:01.574819 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:01.575245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:01.719517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:01.727316 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-662e3a6f-8816-4a13-af47-a295fa333127 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1277 microversion: 2.1 time: 0.168215 Sep 23 15:28:01.727916 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 503/969] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:01 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:02.270569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:02.271195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:02.278064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:02.278571 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:02.279236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:02.279943 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:02.280397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:02.280852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:02.435112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:02.443368 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:02.444869 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:02.446032 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-398e9118-2498-42d8-a84a-70d03d847655 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.179582 Sep 23 15:28:02.446635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 467/970] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:28:02 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:28:02.751123 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:02.751741 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:02.758749 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:02.759230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:02.759665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:02.760389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:02.760872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:02.761421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:02.902245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:02.910908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f5804534-7acc-4d77-8911-30996f967935 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1277 microversion: 2.1 time: 0.164102 Sep 23 15:28:02.911412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 504/971] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:02 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:03.482095 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:03.482993 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:03.490533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:03.491013 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:03.491438 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:03.492122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:03.492568 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:03.493023 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:03.634792 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:03.643807 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:03.645377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:03.646674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d8be68b2-e3df-4006-a200-447330cafe79 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1732 microversion: 2.20 time: 0.170865 Sep 23 15:28:03.647238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 468/972] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:28:03 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:28:03.934580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:03.935228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:03.942098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:03.942583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:03.943017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:03.943716 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:03.944197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:03.944672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:03.989648 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:03.992143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:03.998982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:03.999619 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:04.000182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:04.000907 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:04.001356 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:04.001779 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:04.032983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fb9f1728-cd49-43e4-b7b2-c021c3aaafd9 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047282 Sep 23 15:28:04.033571 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 469/973] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:28:03 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:04.044184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:04.044629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:04.050731 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:04.051222 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:04.051661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:04.052359 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:04.052839 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:04.053264 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:04.083117 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:04.084130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9648e105-5be8-4644-8ad3-002de610f98e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/a0955cf5-bfa6-43eb-8ebe-e4fcf32b0325" status: 200 len: 194 microversion: 2.1 time: 0.043082 Sep 23 15:28:04.084806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 470/974] 10.222.0.75 () {58 vars in 1413 bytes} [Fri Sep 23 15:28:04 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/a0955cf5-bfa6-43eb-8ebe-e4fcf32b0325 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:28:04.090905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ac8cc01a-6f2f-4b55-9e19-b87281c6ecb2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1277 microversion: 2.1 time: 0.160219 Sep 23 15:28:04.091465 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 505/975] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:03 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:04.676504 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:04.677406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:04.688003 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:04.688491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:04.688962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:04.689660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:04.690115 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:04.690543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:04.839318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:04.848052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:04.849537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:04.850713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-28ea0163-6d83-4a69-849e-31d0bc761886 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1719 microversion: 2.20 time: 0.181735 Sep 23 15:28:04.851312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 471/976] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:28:04 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:28:05.114212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:05.114839 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:05.121698 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:05.122168 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:05.122605 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:05.123647 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:05.124119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:05.124569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:05.276227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:05.286334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-487124f8-8aa1-40c1-ace1-4a4e971d965b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.176236 Sep 23 15:28:05.286906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 506/977] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:05 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:05.449415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ab08523-7986-47cd-ae24-502d7ab51d58"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:05.452908 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:05.462053 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:05.462661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:05.463262 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:05.464247 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:05.464948 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:05.465554 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:05.737553 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:05.747561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a8943242-606f-45b3-9f98-d8296a187b7e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "POST /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304612 Sep 23 15:28:05.748504 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 472/978] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:28:05 2022] POST /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:06.310165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:06.310774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:06.317666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:06.318195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:06.318646 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:06.319379 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:06.319901 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:06.320377 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:06.465789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:06.473802 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-43630b9e-8146-4b06-9b6b-bfe3b1bf43ac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.167671 Sep 23 15:28:06.474349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 507/979] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:06 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:07.503303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:07.503994 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:07.511017 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:07.511507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:07.511949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:07.512681 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:07.513140 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:07.513568 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:07.655858 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:07.664355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d174e13b-707a-4556-9a79-c09d6b5bf98f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.169464 Sep 23 15:28:07.664967 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 473/980] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:07 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:08.691424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:08.692097 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:08.699990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:08.700539 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:08.701066 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:08.701842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:08.702361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:08.702832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:08.846724 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:08.854709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-967a0986-ff5e-40c3-be5f-31f68c43db29 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.169457 Sep 23 15:28:08.855283 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 508/981] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:08 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:09.890774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:09.891814 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:09.899483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:09.899968 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:09.900393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:09.901123 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:09.901568 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:09.901987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:10.047215 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:10.055189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-197d369d-a658-471e-a6ef-2cde12f024ab tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.170936 Sep 23 15:28:10.055764 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 474/982] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:09 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:11.083320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:11.083984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:11.094381 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:11.095220 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:11.095928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:11.097783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:11.098246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:11.098692 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:11.234681 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:11.243364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-33c785a9-28d0-4683-8bb2-ece26c5cd1c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.167955 Sep 23 15:28:11.243935 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 509/983] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:11 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:12.269436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:12.270034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:12.276825 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:12.277310 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:12.277742 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:12.278440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:12.278892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:12.279320 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:12.417607 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:12.429030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fac41929-875f-41db-b648-befa56c03265 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.165591 Sep 23 15:28:12.429796 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 475/984] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:12 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:13.370780 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:13.374228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:13.382758 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:13.383244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:13.383672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:13.384379 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:13.384878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:13.385306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:13.416739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8beeee91-6957-44af-b279-23a77fd8d948 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052253 Sep 23 15:28:13.417307 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 510/985] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:28:13 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:13.455599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:13.456178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:13.463316 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:13.463799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:13.464229 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:13.464981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:13.465404 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:13.465805 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:13.525378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:13.526203 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:13.532527 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:13.533387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:13.533387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:13.534066 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:13.534517 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:13.534959 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:13.537944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:13.570017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-dd8f1405-9ef7-4dc2-9fe7-0110622cb4a5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/a0955cf5-bfa6-43eb-8ebe-e4fcf32b0325" status: 200 len: 194 microversion: 2.1 time: 0.048408 Sep 23 15:28:13.570489 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 511/986] 10.222.0.75 () {58 vars in 1413 bytes} [Fri Sep 23 15:28:13 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/a0955cf5-bfa6-43eb-8ebe-e4fcf32b0325 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:28:13.581142 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:13.581850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:13.588621 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:13.589349 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:13.590119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:13.591020 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:13.591652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:13.592253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:13.607924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:13.616554 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ec164758-bbe8-4a7a-b24b-081b3eb7995b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.165020 Sep 23 15:28:13.617548 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 476/987] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:13 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:13.678231 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lazy-loading 'services' on Instance uuid 21b9f1d7-4143-4d97-af21-d148c232a438 {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:28:13.803058 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e883a0d0-e96d-4582-b508-6a59d7f1abd5 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/a0955cf5-bfa6-43eb-8ebe-e4fcf32b0325" status: 202 len: 0 microversion: 2.1 time: 0.225842 Sep 23 15:28:13.803626 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 512/988] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:28:13 2022] DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/a0955cf5-bfa6-43eb-8ebe-e4fcf32b0325 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:28:14.643701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:14.644899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:14.656227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:14.657095 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:14.657822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:14.658963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:14.659714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:14.660535 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:14.801967 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:14.809983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c9ad7aee-ae3e-4384-a566-7f378b36c2ae tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.172962 Sep 23 15:28:14.810555 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 477/989] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:14 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:15.049403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-e23325c5-8567-487f-bb1f-8525c5c7c2f7 req-40384e6c-b61e-4ece-bb37-4b7c9bc5ede1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43e17d3-319f-4b57-ae94-39d418139c9c", "name": "network-vif-plugged", "status": "completed", "tag": "f0af20c2-28ed-4543-be12-2ae4069574a5"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:15.059946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e23325c5-8567-487f-bb1f-8525c5c7c2f7 req-40384e6c-b61e-4ece-bb37-4b7c9bc5ede1 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:15.060429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e23325c5-8567-487f-bb1f-8525c5c7c2f7 req-40384e6c-b61e-4ece-bb37-4b7c9bc5ede1 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:15.060899 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-e23325c5-8567-487f-bb1f-8525c5c7c2f7 req-40384e6c-b61e-4ece-bb37-4b7c9bc5ede1 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:15.073488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-e23325c5-8567-487f-bb1f-8525c5c7c2f7 req-40384e6c-b61e-4ece-bb37-4b7c9bc5ede1 service nova] Creating event network-vif-plugged:f0af20c2-28ed-4543-be12-2ae4069574a5 for instance b43e17d3-319f-4b57-ae94-39d418139c9c on hv-cinder-85501 Sep 23 15:28:15.078544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-e23325c5-8567-487f-bb1f-8525c5c7c2f7 req-40384e6c-b61e-4ece-bb37-4b7c9bc5ede1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033713 Sep 23 15:28:15.079252 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 513/990] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:28:15.835394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:15.836092 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:15.844273 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:15.844893 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:15.845416 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:15.846236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:15.846774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:15.847278 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:15.988872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:15.996616 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d8d93840-93be-46b1-a880-a9d88e587bb7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.166662 Sep 23 15:28:15.997202 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 478/991] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:15 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:16.182143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:16.182939 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:16.192164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:16.192625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:16.193121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:16.193817 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:16.194276 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:16.194707 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:16.226039 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-60d8bd67-f0da-419c-b6fb-add8de760190 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/6ab08523-7986-47cd-ae24-502d7ab51d58" status: 200 len: 194 microversion: 2.1 time: 0.051138 Sep 23 15:28:16.226616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 514/992] 10.222.0.75 () {58 vars in 1413 bytes} [Fri Sep 23 15:28:16 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/6ab08523-7986-47cd-ae24-502d7ab51d58 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:16.240823 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:16.241315 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:16.249203 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:16.249681 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:16.250108 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:16.250789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:16.251237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:16.251654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:16.352151 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lazy-loading 'services' on Instance uuid 21b9f1d7-4143-4d97-af21-d148c232a438 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:28:16.442712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9fa66853-72ee-4310-950c-1388f57be0cd tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/6ab08523-7986-47cd-ae24-502d7ab51d58" status: 202 len: 0 microversion: 2.1 time: 0.205963 Sep 23 15:28:16.443516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 479/993] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:28:16 2022] DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments/6ab08523-7986-47cd-ae24-502d7ab51d58 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:28:17.022375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:17.022884 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:17.032234 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:17.032761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:17.033203 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:17.033904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:17.034366 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:17.034887 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:17.195586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:17.205999 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-43194b9f-be22-46df-9ddf-33bc9f504a24 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1265 microversion: 2.1 time: 0.189754 Sep 23 15:28:17.206610 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 515/994] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:17 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:18.234196 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:18.235320 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:18.239059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=50 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:18.244670 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.245158 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.245596 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.246294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.246749 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.247212 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.392301 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:18.400548 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-17d77289-0aa8-42eb-ae02-bfd8d359c81b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1452 microversion: 2.1 time: 0.173589 Sep 23 15:28:18.401193 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 480/995] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:18 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:18.423052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:18.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:18.426189 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=58 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:18.431548 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.432038 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.432475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.433226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.433680 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.434112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.577902 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:18.586240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bebeae5f-22a2-4f1f-9a73-277960ec1398 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1452 microversion: 2.1 time: 0.167023 Sep 23 15:28:18.586812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 516/996] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:18 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:18.697364 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:18.699702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:18.705941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.706421 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.707835 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.709392 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.709856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.710282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.740695 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4c6c0273-1416-416c-aad9-b6a6b16fe6a6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047732 Sep 23 15:28:18.741420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 481/997] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:28:18 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:28:18.863981 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:18.866188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:18.872088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.872568 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.873380 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.874090 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.874539 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.874956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.909756 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2a691ba1-8d26-4107-b319-dcdd84034ce4 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049734 Sep 23 15:28:18.910205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 517/998] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:28:18 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:28:18.977549 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:18.978253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:18.984434 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.985004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.985499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:18.986191 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:18.986730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:18.987154 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:19.012549 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:28:19.092365 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a8f7b7af-56ac-4908-b160-c291d28e24c7 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 204 len: 0 microversion: 2.1 time: 0.118507 Sep 23 15:28:19.096609 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 482/999] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:28:18 2022] DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:28:19.101767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:19.102380 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:19.115895 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:19.116466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:19.116952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:19.117612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:19.118064 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:19.118598 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:19.598551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:19.608863 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a24367ab-b638-464b-b895-fb69268bdce3 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1671 microversion: 2.1 time: 0.510988 Sep 23 15:28:19.609446 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 518/1000] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:19 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1671 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:20.594991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-32424179-00e0-4f63-a3a0-96d63ea582eb req-543f7c51-87c1-45c6-9a53-3f84ce9ff841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43e17d3-319f-4b57-ae94-39d418139c9c", "tag": "f0af20c2-28ed-4543-be12-2ae4069574a5"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:20.609275 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-32424179-00e0-4f63-a3a0-96d63ea582eb req-543f7c51-87c1-45c6-9a53-3f84ce9ff841 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:20.609783 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-32424179-00e0-4f63-a3a0-96d63ea582eb req-543f7c51-87c1-45c6-9a53-3f84ce9ff841 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:20.610241 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-32424179-00e0-4f63-a3a0-96d63ea582eb req-543f7c51-87c1-45c6-9a53-3f84ce9ff841 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:20.621751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-32424179-00e0-4f63-a3a0-96d63ea582eb req-543f7c51-87c1-45c6-9a53-3f84ce9ff841 service nova] Creating event network-changed:f0af20c2-28ed-4543-be12-2ae4069574a5 for instance b43e17d3-319f-4b57-ae94-39d418139c9c on hv-cinder-85501 Sep 23 15:28:20.627173 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-32424179-00e0-4f63-a3a0-96d63ea582eb req-543f7c51-87c1-45c6-9a53-3f84ce9ff841 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036199 Sep 23 15:28:20.627941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 483/1001] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:20.634471 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:20.635150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:20.641821 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:20.642373 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:20.642871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:20.643625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:20.644133 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:20.645209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:20.781659 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:20.790446 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2f2ec9a1-a46a-4d59-aa9f-74f32a0f513b tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1671 microversion: 2.1 time: 0.160103 Sep 23 15:28:20.791123 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 519/1002] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:20 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:28:21.815665 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:21.817152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:21.823628 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:21.824210 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:21.824744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:21.825478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:21.825929 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:21.826352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:22.091841 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:22.100447 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7e08f9ba-15f9-4c51-af3a-993cf1c3e213 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1671 microversion: 2.1 time: 0.289574 Sep 23 15:28:22.101068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 484/1003] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:21 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:22.489646 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-a917eb95-5c8e-4fdf-a0c0-d43ab7dff82e req-bef02ac9-74f3-43f0-a0e2-0f7fd260c6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b9f1d7-4143-4d97-af21-d148c232a438", "name": "network-vif-deleted", "tag": "75e7bdc4-43db-4f8f-878c-111d10f4749a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:28:22.500812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a917eb95-5c8e-4fdf-a0c0-d43ab7dff82e req-bef02ac9-74f3-43f0-a0e2-0f7fd260c6ca service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:22.501429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a917eb95-5c8e-4fdf-a0c0-d43ab7dff82e req-bef02ac9-74f3-43f0-a0e2-0f7fd260c6ca service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:22.501926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-a917eb95-5c8e-4fdf-a0c0-d43ab7dff82e req-bef02ac9-74f3-43f0-a0e2-0f7fd260c6ca service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:22.686790 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-a917eb95-5c8e-4fdf-a0c0-d43ab7dff82e req-bef02ac9-74f3-43f0-a0e2-0f7fd260c6ca service nova] Creating event network-vif-deleted:75e7bdc4-43db-4f8f-878c-111d10f4749a for instance 21b9f1d7-4143-4d97-af21-d148c232a438 on hv-cinder-85501 Sep 23 15:28:22.692896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-a917eb95-5c8e-4fdf-a0c0-d43ab7dff82e req-bef02ac9-74f3-43f0-a0e2-0f7fd260c6ca service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207703 Sep 23 15:28:22.696800 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 520/1004] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:23.125333 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:23.126494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:23.133115 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:23.133595 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:23.134023 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:23.134719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:23.135165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:23.135594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:23.167987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:23.168838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:23.169419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:23.170055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lazy-loading 'fault' on Instance uuid 21b9f1d7-4143-4d97-af21-d148c232a438 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:28:23.216201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bded8b580f34e08b2890eb3430f4b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fd7ca907fa4806904e1c00b21b5447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:28:23.223857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4c4f44f4-e069-4b46-922a-e1d52ef1979f tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 200 len: 1328 microversion: 2.1 time: 0.103127 Sep 23 15:28:23.224526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 485/1005] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:23 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:24.254265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:24.255542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:24.266097 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:24.266898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:24.267626 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:24.268843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:24.269597 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:24.270309 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:24.283594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] HTTP exception thrown: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Request method failure captured: Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 HTTP/1.1 Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc42CbjD5rkNFCjdSZ33QHnjvF1a0FY5zke0K0C3qLTjYjVQ5FARfCoe67x1-IXVdS9oTI2xld0fS2C75lBByxVxokbE2KriuPPwKJ5ucyzwucZ7QLOReSCbHMwnY1-u8FH06TDY7CEx1OxHHDVX7nwRhGFmGfwDUmG0uweZMlzQj6g Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:28:24.285230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d4fd7ca907fa4806904e1c00b21b5447"}]}] Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4bded8b580f34e08b2890eb3430f4b80 Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:24.286977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '21b9f1d7-4143-4d97-af21-d148c232a438'} Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:24.287961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:24.289639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:24.291088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Returning 404 to user: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:24.291088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-59ee88b4-937f-4cca-add1-776fd6276395 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 404 len: 111 microversion: 2.1 time: 0.041211 Sep 23 15:28:24.291088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 521/1006] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:24 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:28:24.298287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fe7ae013-78cb-4a21-b805-5001465bbab6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '.version_select at 0x7fbb02e64ee0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:24.323148 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fe7ae013-78cb-4a21-b805-5001465bbab6 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473538077" status: 202 len: 0 microversion: 2.1 time: 0.030787 Sep 23 15:28:24.327230 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 486/1007] 10.222.0.75 () {58 vars in 1221 bytes} [Fri Sep 23 15:28:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473538077 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:28:27.304020 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:27.304651 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:27.314074 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:27.314647 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:27.315121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:27.316062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:27.316657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:27.317221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:27.331361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] HTTP exception thrown: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Request method failure captured: Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 HTTP/1.1 Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc42CbjD5rkNFCjdSZ33QHnjvF1a0FY5zke0K0C3qLTjYjVQ5FARfCoe67x1-IXVdS9oTI2xld0fS2C75lBByxVxokbE2KriuPPwKJ5ucyzwucZ7QLOReSCbHMwnY1-u8FH06TDY7CEx1OxHHDVX7nwRhGFmGfwDUmG0uweZMlzQj6g Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:28:27.332917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d4fd7ca907fa4806904e1c00b21b5447"}]}] Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4bded8b580f34e08b2890eb3430f4b80 Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.334298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '21b9f1d7-4143-4d97-af21-d148c232a438'} Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:27.335410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.336894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.338325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Returning 404 to user: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:27.338325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f4e7acfd-a058-4199-9dd1-cdad8787f80e tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 404 len: 111 microversion: 2.1 time: 0.034454 Sep 23 15:28:27.338325 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 522/1008] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:28:27 2022] DELETE /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:28:27.344552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:27.345187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: 21b9f1d7-4143-4d97-af21-d148c232a438] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:27.352672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:27.353151 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:27.353580 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:27.354268 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:27.354710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:27.355134 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:27.368899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] HTTP exception thrown: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Request method failure captured: Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 HTTP/1.1 Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc42CbjD5rkNFCjdSZ33QHnjvF1a0FY5zke0K0C3qLTjYjVQ5FARfCoe67x1-IXVdS9oTI2xld0fS2C75lBByxVxokbE2KriuPPwKJ5ucyzwucZ7QLOReSCbHMwnY1-u8FH06TDY7CEx1OxHHDVX7nwRhGFmGfwDUmG0uweZMlzQj6g Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:28:27.370531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d4fd7ca907fa4806904e1c00b21b5447"}]}] Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 4bded8b580f34e08b2890eb3430f4b80 Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.372004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '21b9f1d7-4143-4d97-af21-d148c232a438'} Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:27.373302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. Sep 23 15:28:27.374576 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:27.375698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Returning 404 to user: Instance 21b9f1d7-4143-4d97-af21-d148c232a438 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:27.375698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-0db3ba18-8f1c-4cd0-aea3-d28becea7ede tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438" status: 404 len: 111 microversion: 2.1 time: 0.032196 Sep 23 15:28:27.375698 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 487/1009] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:27 2022] GET /compute/v2.1/servers/21b9f1d7-4143-4d97-af21-d148c232a438 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:28:28.533998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:28.534544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:28.541768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:28.542260 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:28.542697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:28.543402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:28.543864 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:28.544284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:28.558866 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] HTTP exception thrown: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Request method failure captured: Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: DELETE /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 HTTP/1.1 Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc42CbjD5rkNFCjdSZ33QHnjvF1a0FY5zke0K0C3qLTjYjVQ5FARfCoe67x1-IXVdS9oTI2xld0fS2C75lBByxVxokbE2KriuPPwKJ5ucyzwucZ7QLOReSCbHMwnY1-u8FH06TDY7CEx1OxHHDVX7nwRhGFmGfwDUmG0uweZMlzQj6g Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:28:28.560442 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d4fd7ca907fa4806904e1c00b21b5447"}]}] Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4bded8b580f34e08b2890eb3430f4b80 Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.561928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'b9b92954-0cb5-4c21-ab67-8f80c5be9eb9'} Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:28.562711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.564198 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.565837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Returning 404 to user: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:28.565837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-aa9c83f7-f62c-4534-8439-fbdf834bde22 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 404 len: 111 microversion: 2.1 time: 0.031832 Sep 23 15:28:28.565837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 523/1010] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:28:28 2022] DELETE /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:28:28.571768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:28.572383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] [instance: b9b92954-0cb5-4c21-ab67-8f80c5be9eb9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:28:28.579292 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:28.579787 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:28.580253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:28.581003 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:28:28.581461 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:28:28.581870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:28:28.595422 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] HTTP exception thrown: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Request method failure captured: Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 HTTP/1.1 Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc42CbjD5rkNFCjdSZ33QHnjvF1a0FY5zke0K0C3qLTjYjVQ5FARfCoe67x1-IXVdS9oTI2xld0fS2C75lBByxVxokbE2KriuPPwKJ5ucyzwucZ7QLOReSCbHMwnY1-u8FH06TDY7CEx1OxHHDVX7nwRhGFmGfwDUmG0uweZMlzQj6g Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:28:28.596983 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d4fd7ca907fa4806904e1c00b21b5447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d4fd7ca907fa4806904e1c00b21b5447"}]}] Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: d4fd7ca907fa4806904e1c00b21b5447 Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-206885622 Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 4bded8b580f34e08b2890eb3430f4b80 Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeTestJSON-206885622-project Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.598511 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'b9b92954-0cb5-4c21-ab67-8f80c5be9eb9'} Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:28:28.599478 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. Sep 23 15:28:28.601097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:28:28.602425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] Returning 404 to user: Instance b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:28:28.602425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-cb867b0c-b7ac-4fe2-b451-ad6e573b0950 tempest-AttachVolumeTestJSON-206885622 tempest-AttachVolumeTestJSON-206885622-project] 10.222.0.75 "GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9" status: 404 len: 111 microversion: 2.1 time: 0.031369 Sep 23 15:28:28.602425 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 488/1011] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:28:28 2022] GET /compute/v2.1/servers/b9b92954-0cb5-4c21-ab67-8f80c5be9eb9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:28:34.510415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ddfca25c-6441-4cc1-bccf-31d241c8e593 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb06814e50>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:34.567430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ddfca25c-6441-4cc1-bccf-31d241c8e593 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/33d49528-3b5d-454d-a149-7068274661f6" status: 200 len: 351 microversion: 2.1 time: 0.064045 Sep 23 15:28:34.567993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 524/1012] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:28:34 2022] GET /compute/v2.1/os-volumes/33d49528-3b5d-454d-a149-7068274661f6 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:35.942000 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b4b9e480-ebb2-46c5-9896-5de1280e6ab2 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb03046dc0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:35.993499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b4b9e480-ebb2-46c5-9896-5de1280e6ab2 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/bb43f927-78b4-420e-8b6e-1d98463a91c1" status: 200 len: 350 microversion: 2.1 time: 0.055339 Sep 23 15:28:35.994063 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 489/1013] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:28:35 2022] GET /compute/v2.1/os-volumes/bb43f927-78b4-420e-8b6e-1d98463a91c1 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:37.366687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-26e4e43a-1ad9-4eab-bb4d-241241f6e2d6 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb02edf700>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:37.426392 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-26e4e43a-1ad9-4eab-bb4d-241241f6e2d6 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/fe58fd4e-95fa-48eb-829e-c9b5e7538b98" status: 200 len: 350 microversion: 2.1 time: 0.064181 Sep 23 15:28:37.426957 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 525/1014] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/os-volumes/fe58fd4e-95fa-48eb-829e-c9b5e7538b98 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:37.440623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ab250e54-1e4d-4b99-ac14-44289a1e04e9 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb03073670>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:37.535678 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ab250e54-1e4d-4b99-ac14-44289a1e04e9 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099272 Sep 23 15:28:37.536254 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 490/1015] 10.222.0.75 () {58 vars in 1134 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:37.553045 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b7aceafb-9c3c-4b80-9981-d9349367bc58 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb02f3bd30>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:37.637246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b7aceafb-9c3c-4b80-9981-d9349367bc58 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089339 Sep 23 15:28:37.638084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 526/1016] 10.222.0.75 () {58 vars in 1149 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:37.655375 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5dca2626-7cf0-4be5-afa6-35ebbeedf783 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb02e64d30>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:37.738623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5dca2626-7cf0-4be5-afa6-35ebbeedf783 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087048 Sep 23 15:28:37.739200 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 491/1017] 10.222.0.75 () {58 vars in 1134 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:37.755834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ff9d3c15-e45a-4019-bf8f-cf1e0cea0346 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb0680db80>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:37.842229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ff9d3c15-e45a-4019-bf8f-cf1e0cea0346 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091945 Sep 23 15:28:37.843035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 527/1018] 10.222.0.75 () {58 vars in 1167 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:37.857613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b8c72541-5f3c-4831-838e-fae0aa26aa4d tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb0300c790>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:37.944248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b8c72541-5f3c-4831-838e-fae0aa26aa4d tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090281 Sep 23 15:28:37.944851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 492/1019] 10.222.0.75 () {58 vars in 1170 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:37.967667 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-52f96e67-2a27-4455-b72f-02be40d471d8 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb047fcc10>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:38.054257 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-52f96e67-2a27-4455-b72f-02be40d471d8 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092896 Sep 23 15:28:38.054811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 528/1020] 10.222.0.75 () {58 vars in 1155 bytes} [Fri Sep 23 15:28:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:28:38.071333 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3edb2529-0326-4183-83aa-7b5abcce29da tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb030043a0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:38.156064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3edb2529-0326-4183-83aa-7b5abcce29da tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090441 Sep 23 15:28:38.156623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 493/1021] 10.222.0.75 () {58 vars in 1188 bytes} [Fri Sep 23 15:28:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:28:38.170779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3f3f7642-4316-40da-8c74-a006e76c0849 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] Calling method '.version_select at 0x7fbb02edfc10>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:28:38.252409 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3f3f7642-4316-40da-8c74-a006e76c0849 tempest-VolumesTestJSON-188438978 tempest-VolumesTestJSON-188438978-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085308 Sep 23 15:28:38.253044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 529/1022] 10.222.0.75 () {58 vars in 1155 bytes} [Fri Sep 23 15:28:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:00.390973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:00.391739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:00.396352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:00.398583 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:00.406026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:00.406702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:00.407140 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:00.407887 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:00.408342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:00.408941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:00.440810 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-20e6e4fe-5ddf-4814-9761-7074dc09a364 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051108 Sep 23 15:29:00.441292 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 494/1023] 10.222.0.75 () {60 vars in 1343 bytes} [Fri Sep 23 15:29:00 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:00.504525 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=15 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:00.505360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:00.509733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:00.510254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:00.518043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:00.518466 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:00.518920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:00.519685 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:00.520465 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:00.520966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:00.547401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:29:00.632352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7b828fe5-dfd1-4890-b805-a00e16d50d56 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "DELETE /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 204 len: 0 microversion: 2.20 time: 0.127945 Sep 23 15:29:00.633312 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 530/1024] 10.222.0.75 () {60 vars in 1280 bytes} [Fri Sep 23 15:29:00 2022] DELETE /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 15:29:00.642149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:00.642815 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:00.650046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:00.650584 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:00.651113 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:00.651697 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:00.652210 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:00.652657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:00.790076 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:00.798674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:00.800254 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:00.801924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b37028a0-9b79-41ff-9536-7b070c02ead1 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.164067 Sep 23 15:29:00.802503 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 495/1025] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:29:00 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:29:01.828061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:01.828787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:01.835371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:01.835862 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:01.836334 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:01.837061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:01.837510 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:01.837904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:01.972297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:01.980846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:01.982279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:01.983592 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0c51b03b-7143-4bb1-b597-e2ad2433e805 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1725 microversion: 2.20 time: 0.159938 Sep 23 15:29:01.984218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 531/1026] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:29:01 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:29:03.011649 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:03.012284 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:03.018905 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:03.019380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:03.019818 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:03.020823 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:03.021291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:03.021719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:03.092552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:03.101195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:03.102770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e38b853b47b64567b00092eb32201b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9f84f2d16a4389a4be567cd2be3a8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:03.103942 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c61a3ddb-9430-41a8-832a-cd14a4810841 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 200 len: 1657 microversion: 2.20 time: 0.096335 Sep 23 15:29:03.104508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 496/1027] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:29:03 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 1657 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 15:29:03.206248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-1e2afa93-3521-4683-ab13-9874e22d6a8a req-78dc67ec-a96d-439f-b3b2-b79d15a7d730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37411fb8-ca8b-42de-850e-3ca0d9c9d615", "name": "network-vif-deleted", "tag": "5ce0bfbd-c402-457c-b397-3abfbebd324a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:03.216424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-1e2afa93-3521-4683-ab13-9874e22d6a8a req-78dc67ec-a96d-439f-b3b2-b79d15a7d730 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:03.216967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-1e2afa93-3521-4683-ab13-9874e22d6a8a req-78dc67ec-a96d-439f-b3b2-b79d15a7d730 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:03.217401 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-1e2afa93-3521-4683-ab13-9874e22d6a8a req-78dc67ec-a96d-439f-b3b2-b79d15a7d730 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:03.231998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-1e2afa93-3521-4683-ab13-9874e22d6a8a req-78dc67ec-a96d-439f-b3b2-b79d15a7d730 service nova] Creating event network-vif-deleted:5ce0bfbd-c402-457c-b397-3abfbebd324a for instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 on hv-cinder-85501 Sep 23 15:29:03.238106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-1e2afa93-3521-4683-ab13-9874e22d6a8a req-78dc67ec-a96d-439f-b3b2-b79d15a7d730 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035558 Sep 23 15:29:03.239848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 532/1028] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:04.130863 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:04.132035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:04.139476 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:04.140185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:04.140887 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:04.141772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:04.142381 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:04.142962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:04.158572 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] HTTP exception thrown: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Request method failure captured: Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 HTTP/1.1 Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc4z3H00xaPzOO6KHqe4EjQi5mq37OzzXTCiLUU5mYKx5msIrkyyM0CG8xhdsm9qrJN6by3yC9NhTEOJt-7SEebjNUn3_T7VlD1sFW1Hi6sdmMgNe4q1ClzVDjPTRR8_C2zLVKZt3afFOL-CZ8xx3l_s-aZli-zrP6Cn72DDqX72oP4 Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:29:04.160384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bb9f84f2d16a4389a4be567cd2be3a8a"}]}] Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: e38b853b47b64567b00092eb32201b4d Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:04.168071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '37411fb8-ca8b-42de-850e-3ca0d9c9d615'} Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:29:04.169177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:04.170739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:04.172660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Returning 404 to user: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:29:04.172660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b7668000-b69f-4711-bf96-54bc49c26b09 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 404 len: 111 microversion: 2.20 time: 0.036319 Sep 23 15:29:04.172660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 497/1029] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:29:04 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:29:04.177500 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-51fc8dab-d5cf-455d-86ab-c7fae1e9eae2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '.version_select at 0x7fbb02ffd5e0>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:04.200478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-51fc8dab-d5cf-455d-86ab-c7fae1e9eae2 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355901890" status: 204 len: 0 microversion: 2.20 time: 0.028010 Sep 23 15:29:04.201429 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 533/1030] 10.222.0.75 () {60 vars in 1262 bytes} [Fri Sep 23 15:29:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355901890 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 15:29:05.999445 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:06.000041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:06.006803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:06.007294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:06.007729 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:06.008436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:06.008922 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:06.009348 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:06.023307 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] HTTP exception thrown: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Request method failure captured: Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: DELETE /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 HTTP/1.1 Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc4z3H00xaPzOO6KHqe4EjQi5mq37OzzXTCiLUU5mYKx5msIrkyyM0CG8xhdsm9qrJN6by3yC9NhTEOJt-7SEebjNUn3_T7VlD1sFW1Hi6sdmMgNe4q1ClzVDjPTRR8_C2zLVKZt3afFOL-CZ8xx3l_s-aZli-zrP6Cn72DDqX72oP4 Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:29:06.024974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bb9f84f2d16a4389a4be567cd2be3a8a"}]}] Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: e38b853b47b64567b00092eb32201b4d Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.026795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '37411fb8-ca8b-42de-850e-3ca0d9c9d615'} Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:29:06.027696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.029192 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.030646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Returning 404 to user: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:29:06.030646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fb9ed1d2-fb09-40d5-a1e7-b761d2400124 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "DELETE /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 404 len: 111 microversion: 2.20 time: 0.031318 Sep 23 15:29:06.030646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 498/1031] 10.222.0.75 () {60 vars in 1280 bytes} [Fri Sep 23 15:29:05 2022] DELETE /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:29:06.035657 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:06.036485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 37411fb8-ca8b-42de-850e-3ca0d9c9d615] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:06.045210 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:06.045693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:06.046127 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:06.046853 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:06.047322 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:06.047744 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:06.061668 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] HTTP exception thrown: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Request method failure captured: Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 HTTP/1.1 Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4z3H00xaPzOO6KHqe4EjQi5mq37OzzXTCiLUU5mYKx5msIrkyyM0CG8xhdsm9qrJN6by3yC9NhTEOJt-7SEebjNUn3_T7VlD1sFW1Hi6sdmMgNe4q1ClzVDjPTRR8_C2zLVKZt3afFOL-CZ8xx3l_s-aZli-zrP6Cn72DDqX72oP4 Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:29:06.063389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bb9f84f2d16a4389a4be567cd2be3a8a"}]}] Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: e38b853b47b64567b00092eb32201b4d Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.064982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '37411fb8-ca8b-42de-850e-3ca0d9c9d615'} Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:29:06.065774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. Sep 23 15:29:06.067130 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:06.068263 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Returning 404 to user: Instance 37411fb8-ca8b-42de-850e-3ca0d9c9d615 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:29:06.068263 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-90816a39-06ae-4f8a-934d-aab4fb87e9e3 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615" status: 404 len: 111 microversion: 2.20 time: 0.033706 Sep 23 15:29:06.068263 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 534/1032] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:29:06 2022] GET /compute/v2.1/servers/37411fb8-ca8b-42de-850e-3ca0d9c9d615 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 23 15:29:07.218574 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:07.219142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:07.226691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:07.227184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:07.227618 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:07.228327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:07.228824 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:07.229247 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:07.243290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] HTTP exception thrown: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Request method failure captured: Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: DELETE /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb HTTP/1.1 Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLc4z3H00xaPzOO6KHqe4EjQi5mq37OzzXTCiLUU5mYKx5msIrkyyM0CG8xhdsm9qrJN6by3yC9NhTEOJt-7SEebjNUn3_T7VlD1sFW1Hi6sdmMgNe4q1ClzVDjPTRR8_C2zLVKZt3afFOL-CZ8xx3l_s-aZli-zrP6Cn72DDqX72oP4 Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:29:07.244899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bb9f84f2d16a4389a4be567cd2be3a8a"}]}] Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: e38b853b47b64567b00092eb32201b4d Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.246921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '95199f41-0774-4f39-912e-97a924ef09eb'} Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:29:07.247852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.249397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.250936 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Returning 404 to user: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:29:07.250936 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b4cd5982-4408-4d0c-8439-090f84bf0c6e tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "DELETE /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 404 len: 111 microversion: 2.20 time: 0.031749 Sep 23 15:29:07.250936 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 499/1033] 10.222.0.75 () {60 vars in 1280 bytes} [Fri Sep 23 15:29:07 2022] DELETE /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:29:07.255664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:07.256881 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] [instance: 95199f41-0774-4f39-912e-97a924ef09eb] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:07.263549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:07.264029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:07.264455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:07.265190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:07.265630 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:07.266048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:07.279682 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] HTTP exception thrown: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Request method failure captured: Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb HTTP/1.1 Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLc4z3H00xaPzOO6KHqe4EjQi5mq37OzzXTCiLUU5mYKx5msIrkyyM0CG8xhdsm9qrJN6by3yC9NhTEOJt-7SEebjNUn3_T7VlD1sFW1Hi6sdmMgNe4q1ClzVDjPTRR8_C2zLVKZt3afFOL-CZ8xx3l_s-aZli-zrP6Cn72DDqX72oP4 Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:29:07.281205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bb9f84f2d16a4389a4be567cd2be3a8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bb9f84f2d16a4389a4be567cd2be3a8a"}]}] Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: bb9f84f2d16a4389a4be567cd2be3a8a Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-548995668 Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: e38b853b47b64567b00092eb32201b4d Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeShelveTestJSON-548995668-project Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.283002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '95199f41-0774-4f39-912e-97a924ef09eb'} Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:29:07.283973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. Sep 23 15:29:07.285584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:29:07.286925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] Returning 404 to user: Instance 95199f41-0774-4f39-912e-97a924ef09eb could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:29:07.286925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-78f05840-5b71-4592-8770-62babf822a71 tempest-AttachVolumeShelveTestJSON-548995668 tempest-AttachVolumeShelveTestJSON-548995668-project] 10.222.0.75 "GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb" status: 404 len: 111 microversion: 2.20 time: 0.032022 Sep 23 15:29:07.286925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 535/1034] 10.222.0.75 () {60 vars in 1277 bytes} [Fri Sep 23 15:29:07 2022] GET /compute/v2.1/servers/95199f41-0774-4f39-912e-97a924ef09eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:29:13.145928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1984366514", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "networks": [{"uuid": "bab322e2-8a8f-4b56-81fa-cebe25ebb4eb"}]}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:13.209604 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] validate_networks() for [('bab322e2-8a8f-4b56-81fa-cebe25ebb4eb', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:29:13.911336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:29:13.912318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:29:13.913132 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:29:13.914024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:29:13.914723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:29:13.925355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:13.925866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:13.926278 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:13.927213 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:13.928510 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:13.929024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:13.948249 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Getting quotas for project ace0c8e4f20649e28610cde631bc58b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:29:13.952911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Getting quotas for user a63e79700c854a3f9581a339ee38376e and project ace0c8e4f20649e28610cde631bc58b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:29:13.966278 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:29:13.968897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:29:14.029882 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8975b1e9-391c-4387-85c1-cf40de40030a tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888028 Sep 23 15:29:14.036977 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 500/1035] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:29:14.042416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-582728cd-18ca-4470-9fb9-a64b690634c2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:14.043018 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-582728cd-18ca-4470-9fb9-a64b690634c2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:14.110530 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-582728cd-18ca-4470-9fb9-a64b690634c2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:14.118954 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-582728cd-18ca-4470-9fb9-a64b690634c2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1219 microversion: 2.1 time: 0.080579 Sep 23 15:29:14.119953 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 536/1036] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:14 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:15.143674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:15.144654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:15.154633 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:15.155213 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:15.155723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:15.156504 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:15.157152 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:15.157650 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:15.230030 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:15.239082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-aa558443-3d7f-4fdb-8477-b6ab59dd8b82 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1271 microversion: 2.1 time: 0.099423 Sep 23 15:29:15.239660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 501/1037] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:15 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:16.263084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:16.263626 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:16.272315 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:16.273097 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:16.273523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:16.274281 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:16.274735 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:16.275148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:16.347989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:16.357563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-17c80d4c-ce3d-4777-b5a7-f743a1b82bc9 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1277 microversion: 2.1 time: 0.098448 Sep 23 15:29:16.358340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 537/1038] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:16 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:17.383247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:17.384216 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:17.390663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:17.391713 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:17.392149 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:17.393078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:17.393532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:17.393945 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:17.443367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-73dd7384-73a2-4ac4-bc88-c03aff53aec5 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: .version_select at 0x7fbb02fec9d0>, body: {"keypair": {"name": "tempest-keypair-541621410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSBPvjHyIMQr1SVOahcWDyMYVRxfwzG3q6bP4FcjZqXxaWljg5LvacGTR4c8JvGTN3ujnLzSuAHplyQGDCzX/RyXLXt1kCHq1TDiaRLA2fusCfRokE7rjIDtHxN/FF7Mg=="}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:17.464913 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-73dd7384-73a2-4ac4-bc88-c03aff53aec5 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:29:17.469566 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-73dd7384-73a2-4ac4-bc88-c03aff53aec5 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for user 338a34cb85d7455a9bed32158d4f9497 and project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:29:17.506272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-73dd7384-73a2-4ac4-bc88-c03aff53aec5 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.210327 Sep 23 15:29:17.507651 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 502/1039] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:29:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:17.556991 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:17.568084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0b91558d-fe72-4c48-986d-599306114829 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.189059 Sep 23 15:29:17.569558 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 538/1040] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:17 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:18.253177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-902093f5-a272-44e5-83e7-928cfbe68dce req-c3f63602-8a9e-41f8-89ce-555ae5295493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bedab26-5bb6-46b5-a664-a9f0b9d697f9", "tag": "03b007c0-cf9c-480d-bb2e-fdba7ffb4495"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:18.269946 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-902093f5-a272-44e5-83e7-928cfbe68dce req-c3f63602-8a9e-41f8-89ce-555ae5295493 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:18.270924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-902093f5-a272-44e5-83e7-928cfbe68dce req-c3f63602-8a9e-41f8-89ce-555ae5295493 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:18.271713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-902093f5-a272-44e5-83e7-928cfbe68dce req-c3f63602-8a9e-41f8-89ce-555ae5295493 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:18.288419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-902093f5-a272-44e5-83e7-928cfbe68dce req-c3f63602-8a9e-41f8-89ce-555ae5295493 service nova] Creating event network-changed:03b007c0-cf9c-480d-bb2e-fdba7ffb4495 for instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 on hv-cinder-85501 Sep 23 15:29:18.307710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-902093f5-a272-44e5-83e7-928cfbe68dce req-c3f63602-8a9e-41f8-89ce-555ae5295493 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060272 Sep 23 15:29:18.308449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 503/1041] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:18.593855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:18.594589 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:18.607700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:18.608472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:18.609258 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:18.610247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:18.611871 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:18.616658 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:18.873402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:18.881635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-43343b26-f409-45f6-9fc5-65d5de7d7708 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.293861 Sep 23 15:29:18.882219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 539/1042] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:18 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:19.502435 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1430346823", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62392971-b242-4d1a-af09-6b426905b68b"}], "security_groups": [{"name": "tempest-securitygroup--1936013064"}], "key_name": "tempest-keypair-541621410", "user_data": "}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:19.639533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] validate_networks() for [('62392971-b242-4d1a-af09-6b426905b68b', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:29:19.905335 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:19.906099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:19.914205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:19.915143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:19.915573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:19.916277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:19.916767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:19.917189 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:20.051392 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:29:20.052647 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:29:20.053349 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:29:20.053988 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:29:20.054632 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:29:20.063266 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:20.065742 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:20.066341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:20.066774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:20.067657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:20.068205 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:20.068733 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:20.071502 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2c1b375c-22d9-436f-9cb7-d66b4e18986d tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.170434 Sep 23 15:29:20.072088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 540/1043] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:19 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:20.087365 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:29:20.091548 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for user 338a34cb85d7455a9bed32158d4f9497 and project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:29:20.103736 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:29:20.106199 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:29:20.160359 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6c0dfb3b-4d9a-4042-b697-f3ccf5190058 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.662600 Sep 23 15:29:20.167162 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 504/1044] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:29:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:29:20.172556 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-941ca9a9-d829-46d1-a77b-bb01097067a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:20.173220 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-941ca9a9-d829-46d1-a77b-bb01097067a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:20.230041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-941ca9a9-d829-46d1-a77b-bb01097067a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:20.238051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-941ca9a9-d829-46d1-a77b-bb01097067a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1241 microversion: 2.1 time: 0.069363 Sep 23 15:29:20.238818 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 541/1045] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:20 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:21.097363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:21.097934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:21.106397 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:21.106896 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:21.107342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:21.108056 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:21.108509 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:21.109144 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:21.261101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:21.261703 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:21.268887 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:21.269362 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:21.269784 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:21.270463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:21.271000 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:21.271438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:21.311303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:21.320098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bbec07f5-6aea-4b69-af2e-d470e7920103 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.228396 Sep 23 15:29:21.320705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 505/1046] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:21 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:21.336004 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:21.343813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-16c830c8-3ccc-4f24-b072-e860b46412ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1293 microversion: 2.1 time: 0.086649 Sep 23 15:29:21.344360 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 542/1047] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:21 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:22.343802 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:22.344517 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:22.351969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:22.352598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:22.353114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:22.353931 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:22.354613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:22.355205 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:22.373712 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:22.374471 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:22.390631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:22.391212 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:22.391716 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:22.392693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:22.393385 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:22.394060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:22.541285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:22.552746 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ef8bddd3-f3f7-4240-b39f-72e8b12865bc tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.212592 Sep 23 15:29:22.553543 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:22.553758 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 506/1048] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:22 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:22.569807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2294227b-a7c9-4eff-a418-379fbaff0833 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1367 microversion: 2.1 time: 0.206866 Sep 23 15:29:22.570599 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 543/1049] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:22 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:23.219326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-beda394d-7a7a-4bf7-ab36-c3e15dbeb521 req-d296b9f3-8f9b-49a1-b36e-b464f60a96b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8313736-2707-4a7f-8b8f-2a1a33b07495", "tag": "7a167ae8-ce16-492c-b9d1-ca2217f95dde"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:23.229940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-beda394d-7a7a-4bf7-ab36-c3e15dbeb521 req-d296b9f3-8f9b-49a1-b36e-b464f60a96b0 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:23.231347 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-beda394d-7a7a-4bf7-ab36-c3e15dbeb521 req-d296b9f3-8f9b-49a1-b36e-b464f60a96b0 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:23.231971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-beda394d-7a7a-4bf7-ab36-c3e15dbeb521 req-d296b9f3-8f9b-49a1-b36e-b464f60a96b0 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:23.243552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-beda394d-7a7a-4bf7-ab36-c3e15dbeb521 req-d296b9f3-8f9b-49a1-b36e-b464f60a96b0 service nova] Creating event network-changed:7a167ae8-ce16-492c-b9d1-ca2217f95dde for instance e8313736-2707-4a7f-8b8f-2a1a33b07495 on hv-cinder-85501 Sep 23 15:29:23.249791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-beda394d-7a7a-4bf7-ab36-c3e15dbeb521 req-d296b9f3-8f9b-49a1-b36e-b464f60a96b0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035125 Sep 23 15:29:23.251263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 507/1050] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:23.577232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:23.577847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:23.584462 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:23.585190 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:23.585622 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:23.586317 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:23.586800 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:23.587218 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:23.593918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:23.594848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:23.602432 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:23.603036 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:23.603768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:23.604579 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:23.605266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:23.605793 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:23.726475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:23.735787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9b7aa163-3af0-4349-955b-2c403ce8140c tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.161737 Sep 23 15:29:23.739009 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 544/1051] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:23 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:23.771636 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:23.779965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9816d16d-0f35-4722-b91f-ce49528da608 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1367 microversion: 2.1 time: 0.190295 Sep 23 15:29:23.780541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 508/1052] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:23 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:24.764551 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:24.765181 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:24.773980 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:24.774421 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:24.774996 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:24.775870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:24.776487 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:24.777116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:24.805784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:24.806374 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:24.813694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:24.814186 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:24.814651 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:24.815399 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:24.815834 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:24.816269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:24.928462 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:24.936291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6e6a2b36-19df-48a6-8756-d6b61cf9060b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.178292 Sep 23 15:29:24.936912 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 545/1053] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:24 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:24.960973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:24.968637 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4dfde55b-68cd-4874-be6e-8572998f4d3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1367 microversion: 2.1 time: 0.167785 Sep 23 15:29:24.969217 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 509/1054] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:24 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:25.528160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-83bfff6b-0b04-460d-997b-285e5646af4e req-1fbfa944-1e91-444c-870b-8f2f002f3f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bedab26-5bb6-46b5-a664-a9f0b9d697f9", "name": "network-vif-plugged", "status": "completed", "tag": "03b007c0-cf9c-480d-bb2e-fdba7ffb4495"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:25.538209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-83bfff6b-0b04-460d-997b-285e5646af4e req-1fbfa944-1e91-444c-870b-8f2f002f3f50 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:25.538752 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-83bfff6b-0b04-460d-997b-285e5646af4e req-1fbfa944-1e91-444c-870b-8f2f002f3f50 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:25.539199 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-83bfff6b-0b04-460d-997b-285e5646af4e req-1fbfa944-1e91-444c-870b-8f2f002f3f50 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:25.550759 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-83bfff6b-0b04-460d-997b-285e5646af4e req-1fbfa944-1e91-444c-870b-8f2f002f3f50 service nova] Creating event network-vif-plugged:03b007c0-cf9c-480d-bb2e-fdba7ffb4495 for instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 on hv-cinder-85501 Sep 23 15:29:25.555860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-83bfff6b-0b04-460d-997b-285e5646af4e req-1fbfa944-1e91-444c-870b-8f2f002f3f50 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092931 Sep 23 15:29:25.556448 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 546/1055] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:25.959672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:25.960311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:25.967302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:25.967783 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:25.968211 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:25.968938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:25.969384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:25.969801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:25.993230 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:25.994232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:26.002473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:26.003333 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:26.004304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:26.005291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:26.005856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:26.006347 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:26.141522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:26.149606 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f94967ee-89b1-47f1-8d78-0ddc06361022 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1367 microversion: 2.1 time: 0.161054 Sep 23 15:29:26.150176 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 547/1056] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:25 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:26.247803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:26.256224 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7054cbfa-774c-405f-b6a3-7ea83cdfcc60 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.300656 Sep 23 15:29:26.256820 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 510/1057] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:25 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:27.175169 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:27.176085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:27.186599 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:27.187374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:27.188087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:27.189209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:27.189888 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:27.190492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:27.280990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:27.281598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:27.288235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:27.288767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:27.289204 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:27.289891 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:27.290333 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:27.290743 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:27.339575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:27.347823 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bd1eb665-99e3-4fa0-849f-aa7dc8424677 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1367 microversion: 2.1 time: 0.178765 Sep 23 15:29:27.348424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 548/1058] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:27 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:27.432999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:27.441272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-46ca5620-47d7-40e5-9c65-8590267e4bf3 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1319 microversion: 2.1 time: 0.164935 Sep 23 15:29:27.441844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 511/1059] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:27 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:28.375237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:28.376164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:28.386203 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:28.386678 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:28.387109 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:28.387797 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:28.388240 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:28.388718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:28.466899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:28.467510 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:28.474143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:28.474620 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:28.475046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:28.475730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:28.476175 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:28.476629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:28.527353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:28.535343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5323a65a-dace-42a8-877e-b15bf7172706 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1367 microversion: 2.1 time: 0.167163 Sep 23 15:29:28.536279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 549/1060] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:28 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:28.616529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:28.624927 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-160bc620-6ca7-4aed-920d-53605ca9aea1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1507 microversion: 2.1 time: 0.162579 Sep 23 15:29:28.625567 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 512/1061] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:28 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:29:29.474673 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-f9022617-9990-478c-a129-a1997a6299ad req-0c67cf82-53fb-499d-b6b0-2d5ddc2460ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8313736-2707-4a7f-8b8f-2a1a33b07495", "name": "network-vif-plugged", "status": "completed", "tag": "7a167ae8-ce16-492c-b9d1-ca2217f95dde"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:29.503469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f9022617-9990-478c-a129-a1997a6299ad req-0c67cf82-53fb-499d-b6b0-2d5ddc2460ca service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:29.504502 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f9022617-9990-478c-a129-a1997a6299ad req-0c67cf82-53fb-499d-b6b0-2d5ddc2460ca service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:29.505396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f9022617-9990-478c-a129-a1997a6299ad req-0c67cf82-53fb-499d-b6b0-2d5ddc2460ca service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:29.521221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-f9022617-9990-478c-a129-a1997a6299ad req-0c67cf82-53fb-499d-b6b0-2d5ddc2460ca service nova] Creating event network-vif-plugged:7a167ae8-ce16-492c-b9d1-ca2217f95dde for instance e8313736-2707-4a7f-8b8f-2a1a33b07495 on hv-cinder-85501 Sep 23 15:29:29.527576 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-f9022617-9990-478c-a129-a1997a6299ad req-0c67cf82-53fb-499d-b6b0-2d5ddc2460ca service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055976 Sep 23 15:29:29.528638 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 550/1062] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:29.558988 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:29.559506 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:29.566723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:29.567597 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:29.567710 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:29.568482 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:29.568965 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:29.569403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:29.710715 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:29.719853 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-bc2e47d1-76c7-41f7-bae4-43f54ae70a35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1367 microversion: 2.1 time: 0.164935 Sep 23 15:29:29.720460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 513/1063] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:29 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:30.740308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=4 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:30.745049 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:30.745734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:30.748051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:30.753923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:30.754410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:30.754847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:30.755541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:30.755993 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:30.756431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:30.759753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:30.912106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:30.925065 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3d5b907f-102b-4a4b-a49b-14a749b665ef tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1367 microversion: 2.1 time: 0.185281 Sep 23 15:29:30.925889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 551/1064] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:30 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:31.951028 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:31.952390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:31.954515 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=4 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:31.955178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=16 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:31.956311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:31.962201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:31.962691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:31.963132 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:31.963844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:31.964301 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:31.964769 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:31.969852 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=87 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:32.107557 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:29:32.115864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-27660d67-856e-497a-abb3-a632ca74d8b8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1557 microversion: 2.1 time: 0.168875 Sep 23 15:29:32.116440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 514/1065] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:29:31 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:29:32.139229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:29:32.139855 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:32.146687 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:32.147215 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:32.147677 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:32.148371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:32.148863 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:32.149291 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:32.232303 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a6a06a6b-1e0c-4baa-99a3-d389a92a25bb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096660 Sep 23 15:29:32.233197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 552/1066] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Sep 23 15:29:32 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:33.456621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-53a13954-3459-4943-9e14-ca513f6da2bf req-4404a71b-4065-45db-9da4-fcc209199179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8313736-2707-4a7f-8b8f-2a1a33b07495", "tag": "7a167ae8-ce16-492c-b9d1-ca2217f95dde"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:33.466860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-53a13954-3459-4943-9e14-ca513f6da2bf req-4404a71b-4065-45db-9da4-fcc209199179 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:33.467560 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-53a13954-3459-4943-9e14-ca513f6da2bf req-4404a71b-4065-45db-9da4-fcc209199179 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:33.468085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-53a13954-3459-4943-9e14-ca513f6da2bf req-4404a71b-4065-45db-9da4-fcc209199179 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:33.479480 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-53a13954-3459-4943-9e14-ca513f6da2bf req-4404a71b-4065-45db-9da4-fcc209199179 service nova] Creating event network-changed:7a167ae8-ce16-492c-b9d1-ca2217f95dde for instance e8313736-2707-4a7f-8b8f-2a1a33b07495 on hv-cinder-85501 Sep 23 15:29:33.484700 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-53a13954-3459-4943-9e14-ca513f6da2bf req-4404a71b-4065-45db-9da4-fcc209199179 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032513 Sep 23 15:29:33.487236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 515/1067] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:29:49.315501 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:49.316260 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=9 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:49.321093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f1142c8-8122-4e85-b8b4-735bc46546d6", "device": "/dev/sdb"}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:29:49.323962 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:29:49.330881 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:49.331372 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:49.331805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:49.332548 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:29:49.333127 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:29:49.333467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:29:49.636078 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b1a23df2-2e43-41c8-8541-99c2e766e092 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "POST /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321744 Sep 23 15:29:49.636858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 553/1068] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:29:49 2022] POST /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:30:17.048940 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:17.049489 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:17.051926 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:17.052570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=7 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:17.059581 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:17.060072 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:17.060508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:17.061236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:17.061690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:17.062112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:17.148123 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lazy-loading 'services' on Instance uuid 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:30:17.229313 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f7fd42ad-b05b-4350-b4aa-3620eaaf6472 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9/os-volume_attachments/2f1142c8-8122-4e85-b8b4-735bc46546d6" status: 202 len: 0 microversion: 2.1 time: 0.184544 Sep 23 15:30:17.229936 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 516/1069] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:30:17 2022] DELETE /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9/os-volume_attachments/2f1142c8-8122-4e85-b8b4-735bc46546d6 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:30:18.361978 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:18.362754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:18.368356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:18.369200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:18.381761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:18.382354 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:18.382787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:18.383544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:18.384096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:18.384523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:18.415712 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:30:18.516694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bf92188c-c114-4acf-ab60-12018accb441 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 204 len: 0 microversion: 2.1 time: 0.155845 Sep 23 15:30:18.517299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 554/1070] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:30:18 2022] DELETE /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:30:18.526941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:18.527646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:18.537013 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:18.542231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:18.542231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:18.542231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:18.542231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:18.542690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:18.700305 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:18.711117 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7ed5fa2c-54ee-44db-b19a-2e09558f9f78 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1513 microversion: 2.1 time: 0.188658 Sep 23 15:30:18.712058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 517/1071] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:18 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:19.739952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:19.741147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:19.752564 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:19.753378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:19.754091 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:19.755194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:19.755969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:19.756659 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:19.915676 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:19.923843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1f0ca254-2a67-41a3-b1f8-7160cc9cfe08 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1513 microversion: 2.1 time: 0.191124 Sep 23 15:30:19.924374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 555/1072] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:19 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:20.947222 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:20.955637 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:20.963761 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:20.964240 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:20.965862 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:20.966575 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:20.967193 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:20.968034 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:21.058583 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:21.068061 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f9b576d4-627a-4b92-b0ec-4b4ffe7bd1ce tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 200 len: 1471 microversion: 2.1 time: 0.124702 Sep 23 15:30:21.069807 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 518/1073] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:20 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 1471 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:21.126375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-494e4ede-5c2e-4c7f-af38-38842cacaf7a req-912c2269-98f7-48b9-9bcd-0a36acb6cce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bedab26-5bb6-46b5-a664-a9f0b9d697f9", "name": "network-vif-deleted", "tag": "03b007c0-cf9c-480d-bb2e-fdba7ffb4495"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:21.138338 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-494e4ede-5c2e-4c7f-af38-38842cacaf7a req-912c2269-98f7-48b9-9bcd-0a36acb6cce6 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:21.139224 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-494e4ede-5c2e-4c7f-af38-38842cacaf7a req-912c2269-98f7-48b9-9bcd-0a36acb6cce6 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:21.139971 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-494e4ede-5c2e-4c7f-af38-38842cacaf7a req-912c2269-98f7-48b9-9bcd-0a36acb6cce6 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:21.156340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-494e4ede-5c2e-4c7f-af38-38842cacaf7a req-912c2269-98f7-48b9-9bcd-0a36acb6cce6 service nova] Creating event network-vif-deleted:03b007c0-cf9c-480d-bb2e-fdba7ffb4495 for instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 on hv-cinder-85501 Sep 23 15:30:21.161727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-494e4ede-5c2e-4c7f-af38-38842cacaf7a req-912c2269-98f7-48b9-9bcd-0a36acb6cce6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143319 Sep 23 15:30:21.162620 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 556/1074] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:22.093638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:22.094201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 9bedab26-5bb6-46b5-a664-a9f0b9d697f9] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:22.102237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:22.102964 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:22.103400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:22.104274 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:22.104960 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:22.105390 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:22.119042 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] HTTP exception thrown: Instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 could not be found. Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Request method failure captured: Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 HTTP/1.1 Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDHqOEWVu4xyZZuefaICkU1HCUvv_KtUEvi4HCQq171mf97ExP2l_ho0lL2M3vTFNgXtk96ebb-BubBPipEr6pMy9WSeIY9fAlLVSN-rVCf5fMsYgbSzKO6Y69KWrEEnp6R3IlQM9vPKQeQonZv6-RSqs7XFyILExmNOJtZ950fxGc Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: ace0c8e4f20649e28610cde631bc58b8 Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-VolumesSnapshotTestJSON-994937143 Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:30:22.121084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ace0c8e4f20649e28610cde631bc58b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ace0c8e4f20649e28610cde631bc58b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ace0c8e4f20649e28610cde631bc58b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ace0c8e4f20649e28610cde631bc58b8"}]}] Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-VolumesSnapshotTestJSON-994937143 Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: ace0c8e4f20649e28610cde631bc58b8 Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-994937143 Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-VolumesSnapshotTestJSON-994937143-project Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: a63e79700c854a3f9581a339ee38376e Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-VolumesSnapshotTestJSON-994937143-project Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 could not be found. Sep 23 15:30:22.122737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '9bedab26-5bb6-46b5-a664-a9f0b9d697f9'} Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 could not be found. Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:30:22.123601 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 could not be found. Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 could not be found. Sep 23 15:30:22.124996 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:22.126185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Returning 404 to user: Instance 9bedab26-5bb6-46b5-a664-a9f0b9d697f9 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:30:22.126185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-705bbb69-f4f1-4ac6-aa4a-da7d6cf68e2b tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9" status: 404 len: 111 microversion: 2.1 time: 0.032835 Sep 23 15:30:22.126185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 519/1075] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:22 2022] GET /compute/v2.1/servers/9bedab26-5bb6-46b5-a664-a9f0b9d697f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:30:33.145854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:33.146611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:33.151966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2106157586", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "networks": [{"uuid": "bab322e2-8a8f-4b56-81fa-cebe25ebb4eb"}]}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:33.213159 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] validate_networks() for [('bab322e2-8a8f-4b56-81fa-cebe25ebb4eb', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:30:33.650886 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:30:33.651319 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:30:33.651851 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:30:33.652332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:30:33.652781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:30:33.662709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:33.663194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:33.663624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:33.664357 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:33.664857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:33.665282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:33.682633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Getting quotas for project ace0c8e4f20649e28610cde631bc58b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:30:33.687146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Getting quotas for user a63e79700c854a3f9581a339ee38376e and project ace0c8e4f20649e28610cde631bc58b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:30:33.698983 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:30:33.701424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:30:33.761600 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d62d0ee5-09eb-4331-92fd-5e735cb55a77 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618032 Sep 23 15:30:33.762221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 557/1076] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:30:33.773507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-95199cb2-75d2-49e9-a499-5abd97962ab6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:33.778118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-95199cb2-75d2-49e9-a499-5abd97962ab6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:33.780875 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=8 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:33.781548 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:33.839128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-95199cb2-75d2-49e9-a499-5abd97962ab6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:33.846407 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-95199cb2-75d2-49e9-a499-5abd97962ab6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1219 microversion: 2.1 time: 0.076781 Sep 23 15:30:33.847350 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 520/1077] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:33 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:34.870966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:34.871594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:34.879112 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:34.879616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:34.880053 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:34.880783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:34.881220 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:34.881644 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:34.945251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:34.954516 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ee8aa25e-e82f-4ddf-8e11-188a3e051709 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1271 microversion: 2.1 time: 0.088481 Sep 23 15:30:34.955367 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 558/1078] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:34 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:35.979592 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:35.980373 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:35.987896 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:35.988403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:35.988864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:35.989628 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:35.990072 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:35.990490 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:36.212359 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:36.220446 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-53d62a60-27db-4174-ba98-c602da222bd8 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1319 microversion: 2.1 time: 0.245529 Sep 23 15:30:36.221046 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 521/1079] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:35 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:36.418671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-ec977738-0e92-4f42-814e-53bd55b526ee req-a1c95ed9-2cff-42ea-a07f-0ffd210864c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a97511-2502-4a57-abf5-3e40a374384a", "tag": "cf60d0fa-92a7-4dda-9eaa-7a7599db7c2f"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:36.428786 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-ec977738-0e92-4f42-814e-53bd55b526ee req-a1c95ed9-2cff-42ea-a07f-0ffd210864c8 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:36.429339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-ec977738-0e92-4f42-814e-53bd55b526ee req-a1c95ed9-2cff-42ea-a07f-0ffd210864c8 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:36.429846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-ec977738-0e92-4f42-814e-53bd55b526ee req-a1c95ed9-2cff-42ea-a07f-0ffd210864c8 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:36.442350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-ec977738-0e92-4f42-814e-53bd55b526ee req-a1c95ed9-2cff-42ea-a07f-0ffd210864c8 service nova] Creating event network-changed:cf60d0fa-92a7-4dda-9eaa-7a7599db7c2f for instance 76a97511-2502-4a57-abf5-3e40a374384a on hv-cinder-85501 Sep 23 15:30:36.447746 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-ec977738-0e92-4f42-814e-53bd55b526ee req-a1c95ed9-2cff-42ea-a07f-0ffd210864c8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033041 Sep 23 15:30:36.448485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 559/1080] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:37.243874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:37.246248 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:37.253524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.254011 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.254442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:37.255179 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.255629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.256050 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:37.390849 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:37.399303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-57e7c316-2c8c-47fd-bd4d-50d1cd5f4ec7 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1319 microversion: 2.1 time: 0.159522 Sep 23 15:30:37.400137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 522/1081] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:37 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:37.714770 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:37.715339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:37.724194 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.724764 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.725201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:37.725980 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.726432 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.726856 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:37.755281 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:30:37.839226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-80610683-997a-48af-a7ca-d410340f5df8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 204 len: 0 microversion: 2.1 time: 0.130472 Sep 23 15:30:37.839989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 560/1082] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:30:37 2022] DELETE /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:30:37.848621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:37.850110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:37.856449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.859792 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.860246 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:37.860982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:37.861464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:37.861873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:38.003225 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:38.011163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-215000ff-baed-4d6c-8dd8-8ec5329a298b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1577 microversion: 2.1 time: 0.166459 Sep 23 15:30:38.011827 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 523/1083] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:37 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:38.423612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:38.424286 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:38.431155 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:38.431964 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:38.432703 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:38.433832 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:38.434534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:38.435209 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:38.590724 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:38.598710 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-596f67a0-9358-4d7b-a4cf-0fa5edb51a05 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1319 microversion: 2.1 time: 0.179556 Sep 23 15:30:38.599285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 561/1084] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:38 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:39.034542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:39.035121 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:39.042118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:39.042675 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:39.043177 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:39.043866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:39.044370 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:39.044969 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:39.188065 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:39.196258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-49ba0d7d-37ec-4b65-9eed-49f75fbc071f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1577 microversion: 2.1 time: 0.165676 Sep 23 15:30:39.196897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 524/1085] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:39 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:39.622211 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:39.623570 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:39.630842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:39.631451 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:39.631946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:39.632801 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:39.633323 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:39.633753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:39.767221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:39.775234 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3c338e10-c520-4c96-9fc4-37dfd0bda9ff tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1319 microversion: 2.1 time: 0.157346 Sep 23 15:30:39.775807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 562/1086] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:39 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:40.220059 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:40.220694 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:40.227702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:40.228194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:40.228690 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:40.229363 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:40.229804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:40.230227 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:40.377729 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:40.386383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-de6d5241-a8b5-445b-84ef-a84c43d6ccd9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1577 microversion: 2.1 time: 0.170609 Sep 23 15:30:40.386954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 525/1087] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:40 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:40.799482 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:40.800259 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:40.807382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:40.807867 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:40.808299 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:40.809071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:40.809525 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:40.810053 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:40.946910 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:40.955244 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-19208e61-9081-4a62-b61a-7ab4ddcc08f0 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1319 microversion: 2.1 time: 0.159920 Sep 23 15:30:40.956044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 563/1088] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:40 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:41.409451 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:41.410170 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:41.417273 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:41.417864 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:41.418361 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:41.419300 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:41.419967 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:41.420465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:41.562894 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:41.569919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-919f2725-0403-4b4c-8bd8-70591e386d4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1577 microversion: 2.1 time: 0.164426 Sep 23 15:30:41.570671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 526/1089] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:41 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:41.978278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:41.978908 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:41.987310 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:41.987588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:41.988013 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:41.988830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:41.989279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:41.989696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:42.141735 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:42.153010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cf223afa-c256-41c6-be12-2488d84c33c6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1319 microversion: 2.1 time: 0.176282 Sep 23 15:30:42.153693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 564/1090] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:41 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:42.561605 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-e1439845-56a4-4b0f-b4bc-04c09bfa7b59 req-f666b346-d6b3-4b07-8c5c-9bf5b742fa0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a97511-2502-4a57-abf5-3e40a374384a", "name": "network-vif-plugged", "status": "completed", "tag": "cf60d0fa-92a7-4dda-9eaa-7a7599db7c2f"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:42.583618 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e1439845-56a4-4b0f-b4bc-04c09bfa7b59 req-f666b346-d6b3-4b07-8c5c-9bf5b742fa0e service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:42.584091 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e1439845-56a4-4b0f-b4bc-04c09bfa7b59 req-f666b346-d6b3-4b07-8c5c-9bf5b742fa0e service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:42.584639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-e1439845-56a4-4b0f-b4bc-04c09bfa7b59 req-f666b346-d6b3-4b07-8c5c-9bf5b742fa0e service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:42.598707 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:42.599441 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:42.611600 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-e1439845-56a4-4b0f-b4bc-04c09bfa7b59 req-f666b346-d6b3-4b07-8c5c-9bf5b742fa0e service nova] Creating event network-vif-plugged:cf60d0fa-92a7-4dda-9eaa-7a7599db7c2f for instance 76a97511-2502-4a57-abf5-3e40a374384a on hv-cinder-85501 Sep 23 15:30:42.611796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:42.613242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:42.613242 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:42.614704 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:42.617546 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:42.618311 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:42.621083 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-e1439845-56a4-4b0f-b4bc-04c09bfa7b59 req-f666b346-d6b3-4b07-8c5c-9bf5b742fa0e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063756 Sep 23 15:30:42.624903 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 527/1091] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:30:42.656635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-fab43e31-5660-48fa-8f89-1b42df5fc395 req-151c580b-b73f-4880-a3d5-5083b43c5b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43e17d3-319f-4b57-ae94-39d418139c9c", "name": "network-vif-deleted", "tag": "f0af20c2-28ed-4543-be12-2ae4069574a5"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:42.669261 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-fab43e31-5660-48fa-8f89-1b42df5fc395 req-151c580b-b73f-4880-a3d5-5083b43c5b9a service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:42.669726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-fab43e31-5660-48fa-8f89-1b42df5fc395 req-151c580b-b73f-4880-a3d5-5083b43c5b9a service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:42.670146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-fab43e31-5660-48fa-8f89-1b42df5fc395 req-151c580b-b73f-4880-a3d5-5083b43c5b9a service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:42.691294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-fab43e31-5660-48fa-8f89-1b42df5fc395 req-151c580b-b73f-4880-a3d5-5083b43c5b9a service nova] Creating event network-vif-deleted:f0af20c2-28ed-4543-be12-2ae4069574a5 for instance b43e17d3-319f-4b57-ae94-39d418139c9c on hv-cinder-85501 Sep 23 15:30:42.698871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-fab43e31-5660-48fa-8f89-1b42df5fc395 req-151c580b-b73f-4880-a3d5-5083b43c5b9a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046890 Sep 23 15:30:42.717615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 528/1092] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:30:42.737647 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:42.748071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a8c8308b-e1a5-4c0b-92be-2bbfd5e07c9b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1510 microversion: 2.1 time: 0.155908 Sep 23 15:30:42.750279 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 565/1093] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:42 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:43.176930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:43.177835 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:43.186154 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:43.186654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:43.187089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:43.187795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:43.188243 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:43.189303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:43.333513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:43.343594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3cc20ac8-0d02-451b-bac3-17b1b9f7e8ed tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1319 microversion: 2.1 time: 0.171303 Sep 23 15:30:43.345329 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 529/1094] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:43 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:43.773781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:43.778952 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:43.793724 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:43.795873 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=6 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:43.797559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:43.798001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:43.798575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:43.799306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:43.799756 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:43.800358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:43.849424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:43.849897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:43.850321 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:43.850757 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lazy-loading 'fault' on Instance uuid b43e17d3-319f-4b57-ae94-39d418139c9c {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:30:43.893262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:43.901039 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-63ca38d6-b0a6-4264-9a04-9461b54caca8 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1230 microversion: 2.1 time: 0.131225 Sep 23 15:30:43.901796 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 566/1095] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:43 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1230 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:44.368366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:44.369024 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:44.372021 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:44.377565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:44.378051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:44.378484 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:44.379176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:44.379627 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:44.380117 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:44.543158 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:44.553758 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5a4fda5d-9521-40f5-a369-14d1e3adec67 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1319 microversion: 2.1 time: 0.189202 Sep 23 15:30:44.554349 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 530/1096] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:44 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:44.923948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:44.924632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:44.931388 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:44.931990 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:44.932418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:44.933256 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:44.933711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:44.934134 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:44.969932 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:44.970950 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:44.971413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:44.972140 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lazy-loading 'fault' on Instance uuid b43e17d3-319f-4b57-ae94-39d418139c9c {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:30:45.020505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:45.027730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cec0880a-723e-4c16-9b3d-fb2b992cf469 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 200 len: 1184 microversion: 2.1 time: 0.108134 Sep 23 15:30:45.028463 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 567/1097] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:44 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 1184 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:45.580303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:45.580979 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:45.591517 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:45.591919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:45.592351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:45.593068 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:45.593542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:45.593966 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:45.750480 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:45.762468 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a51fd261-3c2f-460c-9de6-e48845bbc5a5 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1508 microversion: 2.1 time: 0.187965 Sep 23 15:30:45.763721 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 531/1098] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:45 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 15:30:45.786410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d19fbe8b-4ed9-4f66-b685-325af5429b4d", "device": "/dev/sdb"}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:45.788897 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:45.795148 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:45.795635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:45.796071 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:45.796793 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:45.797245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:45.797655 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:46.049526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:46.050150 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:46.057171 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:46.057551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:46.058103 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:46.058874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:46.059357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:46.059781 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:46.074255 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] HTTP exception thrown: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Request method failure captured: Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c HTTP/1.1 Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdBPmRnXYoif8Oafg0h_bp90e0G4G-707FIAByEXCw5Mij8RIgsapNEflc8qA4ss2e-goyTfBm2RtACpmGzgIai-nlNsDHah3-BqnwRY0uAgSAPWF8M-88wpeq2VNPocd24vKxn2GJ86QPqaXgGAq9Cl6cEte7TXmWAfMG_dXpZIa4Q Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:30:46.076098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c05aa308acb842198935488c659d9ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c05aa308acb842198935488c659d9ab3"}]}] Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-TestVolumeBootPattern-772363949 Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: cd5b918b0427408d9a70ca568d75ad58 Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:30:46.077822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'b43e17d3-319f-4b57-ae94-39d418139c9c'} Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:30:46.078762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:30:46.080525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:30:46.082003 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Returning 404 to user: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:30:46.082003 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-05ebd6ce-300d-465f-985c-26f3c9e84850 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 404 len: 111 microversion: 2.1 time: 0.032057 Sep 23 15:30:46.082003 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 532/1099] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:46 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:30:46.089232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fb05d722-a3c1-4c2a-b01b-7f52a049f269 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "POST /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306401 Sep 23 15:30:46.090032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 568/1100] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:30:45 2022] POST /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:30:46.184126 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1084886665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1827241209", "security_groups": [{"name": "tempest-secgroup-smoke-132906259"}], "block_device_mapping_v2": [{"uuid": "1df14dd7-82cf-4559-b75f-9ec26af6051f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80722061-916e-4bee-90cb-3ac06c3dce58"}]}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:46.308136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] validate_networks() for [('80722061-916e-4bee-90cb-3ac06c3dce58', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:30:46.734578 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:30:46.735135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:30:46.735454 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:30:46.735857 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:30:46.736266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:30:46.746035 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:46.746520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:46.746957 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:46.747801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:46.748373 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:46.748871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:46.766266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Getting quotas for project c05aa308acb842198935488c659d9ab3. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:30:46.770410 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Getting quotas for user cd5b918b0427408d9a70ca568d75ad58 and project c05aa308acb842198935488c659d9ab3. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:30:46.828272 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:30:46.831772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1df14dd7-82cf-4559-b75f-9ec26af6051f',volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:30:46.974309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1a735faa-1a19-4161-a916-ff0614eda52f tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793952 Sep 23 15:30:46.974945 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 533/1101] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:30:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:30:46.987229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a0c79fec-3480-4fca-80c3-3e6532ca819b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:46.987845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a0c79fec-3480-4fca-80c3-3e6532ca819b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:47.044095 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-a0c79fec-3480-4fca-80c3-3e6532ca819b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:47.051631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a0c79fec-3480-4fca-80c3-3e6532ca819b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1095 microversion: 2.1 time: 0.069237 Sep 23 15:30:47.052216 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 569/1102] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:46 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:48.075067 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:48.075872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:48.082989 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:48.083457 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:48.083915 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:48.084631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:48.085097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:48.085523 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:48.158861 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:48.166777 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-654066dc-5315-4215-9f8f-6cc9da16182b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1193 microversion: 2.1 time: 0.096157 Sep 23 15:30:48.167749 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 534/1103] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:48 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:49.190534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:49.191132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:49.199665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:49.200165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:49.200827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:49.201450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:49.201918 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:49.202331 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:49.347295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:49.356166 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-da97e77a-5173-4a3e-bffc-e70cce9e6516 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1278 microversion: 2.1 time: 0.169538 Sep 23 15:30:49.356812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 570/1104] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:49 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:49.839064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-f136a6cd-438d-47aa-a4a0-053373e9d03a req-4c095e21-b8a8-4dd3-aae7-1baf7ca0dcbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea", "tag": "e2599f50-9d14-4ba1-bf63-bca221e1f35e"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:30:49.850352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-f136a6cd-438d-47aa-a4a0-053373e9d03a req-4c095e21-b8a8-4dd3-aae7-1baf7ca0dcbb service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:49.851116 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-f136a6cd-438d-47aa-a4a0-053373e9d03a req-4c095e21-b8a8-4dd3-aae7-1baf7ca0dcbb service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:49.851555 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-f136a6cd-438d-47aa-a4a0-053373e9d03a req-4c095e21-b8a8-4dd3-aae7-1baf7ca0dcbb service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:49.863551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-f136a6cd-438d-47aa-a4a0-053373e9d03a req-4c095e21-b8a8-4dd3-aae7-1baf7ca0dcbb service nova] Creating event network-changed:e2599f50-9d14-4ba1-bf63-bca221e1f35e for instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea on hv-cinder-85501 Sep 23 15:30:49.868753 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-f136a6cd-438d-47aa-a4a0-053373e9d03a req-4c095e21-b8a8-4dd3-aae7-1baf7ca0dcbb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033473 Sep 23 15:30:49.869689 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 535/1105] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:30:50.381740 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:50.382311 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:50.389600 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:50.390105 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:50.390541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:50.391250 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:50.391701 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:50.392111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:50.534628 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:50.542624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8591e4b9-24c5-4cfe-ab2a-c38ae7695bbd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1278 microversion: 2.1 time: 0.164982 Sep 23 15:30:50.543557 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 571/1106] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:50 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:51.567528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:51.568233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:51.575182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:51.575962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:51.576557 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:51.577296 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:51.577790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:51.578265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:51.716443 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:51.725291 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-520683b0-d46f-481f-989d-1262d81a7052 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1278 microversion: 2.1 time: 0.162679 Sep 23 15:30:51.725872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 536/1107] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:51 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:52.750708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:52.751324 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:52.759629 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:52.760361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:52.760810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:52.761645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:52.762282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:52.762716 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:52.767313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:52.903035 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:52.911559 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cd703637-42a1-42ea-b576-976463bffeac tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1278 microversion: 2.1 time: 0.165937 Sep 23 15:30:52.922645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 572/1108] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:52 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:53.934501 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:53.935158 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:53.942092 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:53.942579 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:53.943018 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:53.943716 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:53.944174 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:53.944624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:54.080434 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:54.088469 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-32b09884-975a-4667-92d2-6d90d99ab03d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.158078 Sep 23 15:30:54.089057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 537/1109] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:53 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:55.114716 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:55.115320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:55.125882 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:55.126668 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:55.127370 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:55.128519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:55.129220 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:55.129875 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:55.272688 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:55.280792 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-58a5d3f8-ee83-4466-a751-834a423348e1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.171529 Sep 23 15:30:55.281611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 573/1110] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:55 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:56.307632 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:56.308986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:56.324124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:56.325005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:56.325723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:56.326863 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:56.327578 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:56.328454 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:56.484563 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:56.496055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8f02490d-3749-45d1-a4e7-09d447678005 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.194850 Sep 23 15:30:56.496635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 538/1111] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:56 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:57.529355 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:57.530221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:57.533308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:57.539079 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:57.539565 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:57.540006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:57.540731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:57.541186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:57.541611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:57.685254 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:57.693921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b1d28155-cf0d-48ff-a27d-4da4d1b5d9b4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.170868 Sep 23 15:30:57.694461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 574/1112] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:57 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:58.720202 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:58.721176 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:58.724082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:58.725146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:58.734456 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:58.734943 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:58.735362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:58.736064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:58.736521 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:58.736980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:58.881258 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:30:58.889485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-058daf46-61fc-4ac8-8b63-9edefc476143 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.175309 Sep 23 15:30:58.890058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 539/1113] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:58 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:30:59.916909 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:30:59.917813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:30:59.927878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:59.928558 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:59.929252 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:30:59.930285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:30:59.930916 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:30:59.931528 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:00.082549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:00.096157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-80d59e9d-3cea-458a-93fb-0deabcc360d9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.185367 Sep 23 15:31:00.096984 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 575/1114] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:30:59 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:01.127797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:01.128429 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:01.135382 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:01.135874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:01.136313 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:01.137051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:01.137505 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:01.137938 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:01.276093 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:01.279612 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=100 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:01.285320 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-835e03b7-3d16-4bda-98fe-2ef3025fffe4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.163250 Sep 23 15:31:01.285895 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 540/1115] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:01 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:02.308473 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:02.309099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:02.317251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:02.317882 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:02.318459 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:02.319175 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:02.319761 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:02.320389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:02.459261 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:02.471972 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0b8f252c-66c9-4916-986a-d46c825b33b2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.167165 Sep 23 15:31:02.472809 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 576/1116] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:02 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:03.496090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:03.496701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:03.503911 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:03.504415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:03.504870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:03.505587 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:03.506042 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:03.506471 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:03.644492 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:03.652499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2901e033-21f6-47e9-8f63-78528859a33a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.161284 Sep 23 15:31:03.653120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 541/1117] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:03 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:04.676679 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:04.677264 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:04.679600 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:04.685044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:04.685521 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:04.685948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:04.686634 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:04.687101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:04.687534 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:04.824101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:04.832849 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d5e858a7-5129-4ea3-a1e7-5be85e502e5b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.160843 Sep 23 15:31:04.833406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 577/1118] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:04 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:05.859962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:05.861247 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:05.864926 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:05.874320 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:05.875110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:05.875824 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:05.876853 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:05.877477 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:05.877921 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:06.026419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:06.038105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d7a991c8-0b52-4c79-ab38-63a789873eb5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.184392 Sep 23 15:31:06.038858 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 542/1119] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:05 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:07.067284 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:07.067896 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:07.078522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:07.079228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:07.079787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:07.080487 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:07.080973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:07.081402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:07.222573 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:07.230822 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-de6c9080-722f-4576-99f5-d31da4dbbb4c tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.169473 Sep 23 15:31:07.231671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 578/1120] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:07 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:07.699667 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:07.700173 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:07.708628 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:07.709115 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:07.709540 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:07.710240 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:07.710692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:07.711116 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:07.804025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lazy-loading 'services' on Instance uuid 76a97511-2502-4a57-abf5-3e40a374384a {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:31:07.881760 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1ab99c33-6ca4-42ce-b6d5-85b0226033f1 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "DELETE /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a/os-volume_attachments/d19fbe8b-4ed9-4f66-b685-325af5429b4d" status: 202 len: 0 microversion: 2.1 time: 0.188261 Sep 23 15:31:07.882459 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 543/1121] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:31:07 2022] DELETE /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a/os-volume_attachments/d19fbe8b-4ed9-4f66-b685-325af5429b4d => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:31:08.258630 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:08.259632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:08.269571 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:08.270062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:08.270500 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:08.271201 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:08.271671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:08.272081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:08.421424 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:08.430590 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-3105a701-5468-4a4e-8e86-0dd7f95d3aca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.179019 Sep 23 15:31:08.431197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 579/1122] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:08 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:08.682691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-3abd61b6-f55d-477c-8fdc-dede7ba86e84 req-f0b47c5a-5548-47d2-8c35-9bd598b872d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea", "name": "network-vif-plugged", "status": "completed", "tag": "e2599f50-9d14-4ba1-bf63-bca221e1f35e"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:08.695963 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-3abd61b6-f55d-477c-8fdc-dede7ba86e84 req-f0b47c5a-5548-47d2-8c35-9bd598b872d4 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:08.696444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-3abd61b6-f55d-477c-8fdc-dede7ba86e84 req-f0b47c5a-5548-47d2-8c35-9bd598b872d4 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:08.696928 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-3abd61b6-f55d-477c-8fdc-dede7ba86e84 req-f0b47c5a-5548-47d2-8c35-9bd598b872d4 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:08.711023 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-3abd61b6-f55d-477c-8fdc-dede7ba86e84 req-f0b47c5a-5548-47d2-8c35-9bd598b872d4 service nova] Creating event network-vif-plugged:e2599f50-9d14-4ba1-bf63-bca221e1f35e for instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea on hv-cinder-85501 Sep 23 15:31:08.716369 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-3abd61b6-f55d-477c-8fdc-dede7ba86e84 req-f0b47c5a-5548-47d2-8c35-9bd598b872d4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037902 Sep 23 15:31:08.716995 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 544/1123] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:31:09.011273 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:09.011765 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:09.018664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:09.019139 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:09.019963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:09.020788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:09.021440 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:09.021921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:09.047972 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Going to try to terminate instance {{(pid=120918) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:31:09.129762 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7c959cec-00d1-426b-9b58-40e29d2f22a6 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "DELETE /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 204 len: 0 microversion: 2.1 time: 0.122072 Sep 23 15:31:09.130341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 580/1124] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:31:09 2022] DELETE /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:31:09.139213 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:09.139910 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:09.146236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:09.146717 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:09.147198 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:09.147825 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:09.148271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:09.148749 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:09.294025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:09.302793 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3b237382-1f4b-4052-ab0d-25afde4d8d32 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1514 microversion: 2.1 time: 0.167743 Sep 23 15:31:09.303360 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 545/1125] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:09 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:09.466722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:09.467729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:09.476167 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:09.476675 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:09.477116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:09.477824 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:09.478290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:09.478715 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:09.612869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:09.621705 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f98b2dd1-13a5-4805-8e80-8ef172a07b82 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.162427 Sep 23 15:31:09.622272 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 581/1126] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:09 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:10.334444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:10.335411 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:10.346641 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:10.347136 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:10.347575 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:10.348266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:10.348753 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:10.349179 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:10.495442 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:10.503309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-32516542-0b18-4e49-865e-7218de5abe5e tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1514 microversion: 2.1 time: 0.175621 Sep 23 15:31:10.503858 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 546/1127] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:10 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:10.646742 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:10.647406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:10.654382 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:10.654899 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:10.655339 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:10.656038 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:10.656499 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:10.656966 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:10.802022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:10.814285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d4a3514b-b3e4-47fc-be63-0d819957b0b9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1266 microversion: 2.1 time: 0.171873 Sep 23 15:31:10.815486 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 582/1128] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:10 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:11.531219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:11.532210 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:11.543903 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:11.544708 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:11.545472 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:11.546713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:11.547467 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:11.548178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:11.727491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:11.740440 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1988cbb3-34cf-4169-bb91-d6569052e2a2 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1514 microversion: 2.1 time: 0.215744 Sep 23 15:31:11.741255 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 547/1129] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:11 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:11.837940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:11.839304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:11.845979 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:11.846594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:11.847146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:11.847865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:11.848328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:11.848858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:11.984032 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:11.992619 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-0ba009f4-9de4-406b-81ac-5fa56c1c0f69 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1453 microversion: 2.1 time: 0.158719 Sep 23 15:31:11.993191 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 583/1130] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:11 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:12.018550 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:12.019168 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:12.025357 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:12.025851 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:12.026280 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:12.027010 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:12.027466 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:12.027892 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:12.172404 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:12.180830 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-73fd222d-1c98-404d-aed9-23764aebb970 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1453 microversion: 2.1 time: 0.168663 Sep 23 15:31:12.181402 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 548/1131] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:12 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:12.770252 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:12.771129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:12.779890 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:12.780544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:12.781290 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:12.782221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:12.782827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:12.783413 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:12.788215 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-08a32f90-6381-4059-bf4e-8013d11120d2 req-25c69ba9-b4aa-488d-add8-89e826d28a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a97511-2502-4a57-abf5-3e40a374384a", "name": "network-vif-deleted", "tag": "cf60d0fa-92a7-4dda-9eaa-7a7599db7c2f"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:12.819434 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-08a32f90-6381-4059-bf4e-8013d11120d2 req-25c69ba9-b4aa-488d-add8-89e826d28a27 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:12.821332 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-08a32f90-6381-4059-bf4e-8013d11120d2 req-25c69ba9-b4aa-488d-add8-89e826d28a27 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:12.822055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-08a32f90-6381-4059-bf4e-8013d11120d2 req-25c69ba9-b4aa-488d-add8-89e826d28a27 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:12.839064 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-08a32f90-6381-4059-bf4e-8013d11120d2 req-25c69ba9-b4aa-488d-add8-89e826d28a27 service nova] Creating event network-vif-deleted:cf60d0fa-92a7-4dda-9eaa-7a7599db7c2f for instance 76a97511-2502-4a57-abf5-3e40a374384a on hv-cinder-85501 Sep 23 15:31:12.845880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-08a32f90-6381-4059-bf4e-8013d11120d2 req-25c69ba9-b4aa-488d-add8-89e826d28a27 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064440 Sep 23 15:31:12.847026 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 549/1132] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:31:12.917845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63e79700c854a3f9581a339ee38376e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace0c8e4f20649e28610cde631bc58b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:12.928653 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6378f024-c83e-44b3-bfe7-706840151f7f tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 200 len: 1472 microversion: 2.1 time: 0.164891 Sep 23 15:31:12.929608 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 584/1133] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:12 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:13.952949 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:13.953612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] [instance: 76a97511-2502-4a57-abf5-3e40a374384a] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:13.961088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:13.961584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:13.962448 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:13.963152 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:13.963602 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:13.964021 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:13.979130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-776acbfa-2e40-43a5-a3b4-6c40e82d6579 req-bee00963-5cef-4bf8-8792-7aa08b5c8857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea", "tag": "e2599f50-9d14-4ba1-bf63-bca221e1f35e"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:13.979785 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] HTTP exception thrown: Instance 76a97511-2502-4a57-abf5-3e40a374384a could not be found. Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Request method failure captured: Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a HTTP/1.1 Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdDHqOEWVu4xyZZuefaICkU1HCUvv_KtUEvi4HCQq171mf97ExP2l_ho0lL2M3vTFNgXtk96ebb-BubBPipEr6pMy9WSeIY9fAlLVSN-rVCf5fMsYgbSzKO6Y69KWrEEnp6R3IlQM9vPKQeQonZv6-RSqs7XFyILExmNOJtZ950fxGc Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: ace0c8e4f20649e28610cde631bc58b8 Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesSnapshotTestJSON-994937143 Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:31:13.981447 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ace0c8e4f20649e28610cde631bc58b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_ace0c8e4f20649e28610cde631bc58b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/ace0c8e4f20649e28610cde631bc58b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/ace0c8e4f20649e28610cde631bc58b8"}]}] Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesSnapshotTestJSON-994937143 Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: ace0c8e4f20649e28610cde631bc58b8 Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-994937143 Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesSnapshotTestJSON-994937143-project Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: a63e79700c854a3f9581a339ee38376e Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesSnapshotTestJSON-994937143-project Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 76a97511-2502-4a57-abf5-3e40a374384a could not be found. Sep 23 15:31:13.982973 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '76a97511-2502-4a57-abf5-3e40a374384a'} Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a97511-2502-4a57-abf5-3e40a374384a could not be found. Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:31:13.983783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a97511-2502-4a57-abf5-3e40a374384a could not be found. Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a97511-2502-4a57-abf5-3e40a374384a could not be found. Sep 23 15:31:13.985247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:31:13.986461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] Returning 404 to user: Instance 76a97511-2502-4a57-abf5-3e40a374384a could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:31:13.986461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7687c5ca-a23b-43b8-b08c-1bc7047dfc69 tempest-VolumesSnapshotTestJSON-994937143 tempest-VolumesSnapshotTestJSON-994937143-project] 10.222.0.75 "GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a" status: 404 len: 111 microversion: 2.1 time: 0.033931 Sep 23 15:31:13.986461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 585/1134] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:13 2022] GET /compute/v2.1/servers/76a97511-2502-4a57-abf5-3e40a374384a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 15:31:13.989041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-776acbfa-2e40-43a5-a3b4-6c40e82d6579 req-bee00963-5cef-4bf8-8792-7aa08b5c8857 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:13.998294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-776acbfa-2e40-43a5-a3b4-6c40e82d6579 req-bee00963-5cef-4bf8-8792-7aa08b5c8857 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:13.998294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-776acbfa-2e40-43a5-a3b4-6c40e82d6579 req-bee00963-5cef-4bf8-8792-7aa08b5c8857 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:14.013924 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-776acbfa-2e40-43a5-a3b4-6c40e82d6579 req-bee00963-5cef-4bf8-8792-7aa08b5c8857 service nova] Creating event network-changed:e2599f50-9d14-4ba1-bf63-bca221e1f35e for instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea on hv-cinder-85501 Sep 23 15:31:14.019304 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-776acbfa-2e40-43a5-a3b4-6c40e82d6579 req-bee00963-5cef-4bf8-8792-7aa08b5c8857 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102475 Sep 23 15:31:14.020194 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 550/1135] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:31:32.342252 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:32.343248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:32.346101 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:32.346793 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:32.352407 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:32.352923 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:32.353358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:32.354051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:32.354501 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:32.354944 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:32.381650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-13b16447-4bb7-467c-a15e-d4d0aa328380 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/ips" status: 200 len: 150 microversion: 2.1 time: 0.046111 Sep 23 15:31:32.382217 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 586/1136] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:31:32 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:31:33.785232 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=17 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:33.785998 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:33.791031 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5896118d-e7bb-4c9c-aec9-e2739e09ee81"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:33.793714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:33.801886 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:33.802372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:33.802805 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:33.803506 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:33.803962 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:33.804376 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:34.103531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c635e8f0-0cee-4385-8047-36d566171e2c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320575 Sep 23 15:31:34.104156 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 551/1137] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:31:33 2022] POST /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:31:41.712860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1858351b-19ec-47c0-8acb-2dd1ed4ab46b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: .version_select at 0x7fbb0680d040>, body: {"keypair": {"name": "tempest-keypair-859431465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUCNQkxr8Y0yZqcoA5NfzIVOAOVbTZvxJC/f0K4jdp0id0CvP5HgcS04X6/t8eMaJQBpIUQsBREUV55SjGin2Re43nkgHK/qyC7YVb5OhKtkOadRzGNwIWU7i8K8jzl3g=="}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:41.730522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-1858351b-19ec-47c0-8acb-2dd1ed4ab46b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:31:41.734779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-1858351b-19ec-47c0-8acb-2dd1ed4ab46b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for user 338a34cb85d7455a9bed32158d4f9497 and project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:31:41.748893 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1858351b-19ec-47c0-8acb-2dd1ed4ab46b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [3007f49c-ea1b-4d1c-ab90-2ad62cd9c669] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 15:31:42.376458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=4 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:42.761798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO oslo.messaging._drivers.impl_rabbit [None req-1858351b-19ec-47c0-8acb-2dd1ed4ab46b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [3007f49c-ea1b-4d1c-ab90-2ad62cd9c669] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 36954. Sep 23 15:31:42.782412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1858351b-19ec-47c0-8acb-2dd1ed4ab46b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.075542 Sep 23 15:31:42.783076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 587/1138] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:31:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:31:44.123842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:44.124644 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:44.129299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1006449827", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62392971-b242-4d1a-af09-6b426905b68b"}], "security_groups": [{"name": "tempest-securitygroup--146081954"}], "key_name": "tempest-keypair-859431465", "user_data": "}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:44.237562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] validate_networks() for [('62392971-b242-4d1a-af09-6b426905b68b', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:31:44.646193 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:31:44.646635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:31:44.647089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:31:44.647493 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:31:44.647893 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:31:44.658480 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:44.658958 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:44.659384 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:44.660099 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:44.660570 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:44.661009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:44.678696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:31:44.682856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for user 338a34cb85d7455a9bed32158d4f9497 and project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:31:44.695082 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:31:44.697512 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:31:44.754282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d232ed50-1ff9-433c-a9cf-39377153f76c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.631840 Sep 23 15:31:44.754990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 552/1139] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:31:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:31:44.768222 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-4a2b0c90-a99e-4645-a7e3-e22e12f86804 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:44.768891 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-4a2b0c90-a99e-4645-a7e3-e22e12f86804 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:44.827869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-4a2b0c90-a99e-4645-a7e3-e22e12f86804 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:44.835295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-4a2b0c90-a99e-4645-a7e3-e22e12f86804 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1241 microversion: 2.1 time: 0.071599 Sep 23 15:31:44.835869 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 588/1140] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:44 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:45.862066 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:45.862784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:45.872168 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:45.872674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:45.873101 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:45.873779 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:45.874221 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:45.874645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:45.938776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:45.947391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2ebb7fe3-1ecb-491a-a0f3-e12cad156158 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1293 microversion: 2.1 time: 0.090972 Sep 23 15:31:45.948031 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 553/1141] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:45 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:46.971477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:46.972204 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:46.979205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:46.979693 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:46.980132 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:46.980995 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:46.981461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:46.981886 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:47.046122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:47.054337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-43d09d3a-79cc-4700-8ea3-f5eb7230ce09 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1299 microversion: 2.1 time: 0.087276 Sep 23 15:31:47.055152 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 589/1142] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:46 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:47.881786 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-8ec80c32-9217-413f-b6bc-e9b342a2f763 req-baa4558c-8a1b-41e8-9bb7-56ad9fbb445b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e", "tag": "52440fb8-1f32-4aab-a069-1171a8484b8b"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:47.892415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-8ec80c32-9217-413f-b6bc-e9b342a2f763 req-baa4558c-8a1b-41e8-9bb7-56ad9fbb445b service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:47.892932 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-8ec80c32-9217-413f-b6bc-e9b342a2f763 req-baa4558c-8a1b-41e8-9bb7-56ad9fbb445b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:47.893367 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-8ec80c32-9217-413f-b6bc-e9b342a2f763 req-baa4558c-8a1b-41e8-9bb7-56ad9fbb445b service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:47.904989 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-8ec80c32-9217-413f-b6bc-e9b342a2f763 req-baa4558c-8a1b-41e8-9bb7-56ad9fbb445b service nova] Creating event network-changed:52440fb8-1f32-4aab-a069-1171a8484b8b for instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e on hv-cinder-85501 Sep 23 15:31:47.909803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-8ec80c32-9217-413f-b6bc-e9b342a2f763 req-baa4558c-8a1b-41e8-9bb7-56ad9fbb445b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031803 Sep 23 15:31:47.910396 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 554/1143] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:48.079717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:48.080277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:48.088702 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:48.089535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:48.090011 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:48.091197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:48.091700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:48.092116 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:48.229016 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:48.237588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5bf0f30b-d54f-4918-952e-a12798393ad0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1366 microversion: 2.1 time: 0.162867 Sep 23 15:31:48.238498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 590/1144] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:48 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:49.266579 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:49.267409 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:49.275705 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:49.276303 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:49.276896 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:49.278444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:49.279029 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:49.279556 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:49.416144 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:49.425331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-306b7b3c-76bb-43dc-8a08-74dd160841fb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1366 microversion: 2.1 time: 0.166384 Sep 23 15:31:49.425903 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 555/1145] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:49 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:50.456797 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:50.457419 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:50.464451 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:50.464965 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:50.465402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:50.466191 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:50.466652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:50.467076 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:50.599719 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:50.607624 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-daf32295-1a76-4389-bd63-80bd1e3bf50b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1366 microversion: 2.1 time: 0.155011 Sep 23 15:31:50.608197 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 591/1146] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:50 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:51.636098 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:51.637736 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:51.645809 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:51.646290 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:51.646714 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:51.647408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:51.647853 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:51.648269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:51.785831 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:51.793766 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c9b9f9a8-b2e3-4f9b-aaf6-a35037da7127 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1366 microversion: 2.1 time: 0.164724 Sep 23 15:31:51.794407 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 556/1147] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:51 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:52.817022 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:52.817623 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:52.824695 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:52.825159 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:52.825904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:52.826637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:52.827097 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:52.827508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:52.898187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-c91464e7-b402-4922-a57a-71cd5bb854e4 req-b8fca883-8b9c-43d2-9501-7fd79070f8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e", "name": "network-vif-plugged", "status": "completed", "tag": "52440fb8-1f32-4aab-a069-1171a8484b8b"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:52.912298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c91464e7-b402-4922-a57a-71cd5bb854e4 req-b8fca883-8b9c-43d2-9501-7fd79070f8f8 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:52.912877 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c91464e7-b402-4922-a57a-71cd5bb854e4 req-b8fca883-8b9c-43d2-9501-7fd79070f8f8 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:52.913565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c91464e7-b402-4922-a57a-71cd5bb854e4 req-b8fca883-8b9c-43d2-9501-7fd79070f8f8 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:52.925778 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-c91464e7-b402-4922-a57a-71cd5bb854e4 req-b8fca883-8b9c-43d2-9501-7fd79070f8f8 service nova] Creating event network-vif-plugged:52440fb8-1f32-4aab-a069-1171a8484b8b for instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e on hv-cinder-85501 Sep 23 15:31:52.930825 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-c91464e7-b402-4922-a57a-71cd5bb854e4 req-b8fca883-8b9c-43d2-9501-7fd79070f8f8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036450 Sep 23 15:31:52.931804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 557/1148] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:31:52.975730 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:52.983904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f027e4cc-a8b2-428c-ad8e-b58c1877be79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1366 microversion: 2.1 time: 0.171079 Sep 23 15:31:52.984629 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 592/1149] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:52 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:54.013203 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:54.014556 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:54.025165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:54.025974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:54.026702 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:54.027887 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:54.028661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:54.029362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:54.174658 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:54.182979 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-75971b15-0777-406f-998d-90d33e835939 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1366 microversion: 2.1 time: 0.177671 Sep 23 15:31:54.183566 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 558/1150] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:54 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:55.211146 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:55.212174 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:55.215426 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=6 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:55.224574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:55.225417 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:55.226144 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:55.227353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:55.228107 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:55.228882 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:55.374049 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:31:55.382523 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5708bb03-2618-4af5-92d1-1c1327815fd6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1555 microversion: 2.1 time: 0.177971 Sep 23 15:31:55.383072 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 593/1151] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:31:55 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:31:55.406988 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:31:55.407526 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:31:55.409381 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:55.410051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:55.416553 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:55.417060 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:55.417491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:55.418182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:55.418631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:55.419049 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:55.496950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d852241c-6560-4f8f-af44-2b34b218538d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093637 Sep 23 15:31:55.497716 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 559/1152] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Sep 23 15:31:55 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:31:56.468929 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-ff77115b-52d6-4c86-89a9-36ba12fff308 req-e5b433e4-063f-4eac-8b13-54807805f2bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e", "tag": "52440fb8-1f32-4aab-a069-1171a8484b8b"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:31:56.479072 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-ff77115b-52d6-4c86-89a9-36ba12fff308 req-e5b433e4-063f-4eac-8b13-54807805f2bb service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:31:56.479506 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-ff77115b-52d6-4c86-89a9-36ba12fff308 req-e5b433e4-063f-4eac-8b13-54807805f2bb service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:31:56.479931 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-ff77115b-52d6-4c86-89a9-36ba12fff308 req-e5b433e4-063f-4eac-8b13-54807805f2bb service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:31:56.491352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-ff77115b-52d6-4c86-89a9-36ba12fff308 req-e5b433e4-063f-4eac-8b13-54807805f2bb service nova] Creating event network-changed:52440fb8-1f32-4aab-a069-1171a8484b8b for instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e on hv-cinder-85501 Sep 23 15:31:56.497081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-ff77115b-52d6-4c86-89a9-36ba12fff308 req-e5b433e4-063f-4eac-8b13-54807805f2bb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031916 Sep 23 15:31:56.497702 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 594/1153] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:01.119295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:33:01.120299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Fri Sep 23 15:33:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e/ips (ip 10.222.0.75) !!! Sep 23 15:33:01.121285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:01.122730 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=34 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:01.131051 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:01.131869 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:01.144241 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:01.144750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:01.145189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:01.145888 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:01.146340 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:01.146774 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:01.171803 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4e67f52c-f860-4187-a8e4-b4c6e2b70bd3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e/ips" status: 200 len: 148 microversion: 2.1 time: 0.056641 Sep 23 15:33:01.172375 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 560/1154] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:33:01 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e/ips => generated 148 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:01.183737 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:01.184509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=32 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:01.191219 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5896118d-e7bb-4c9c-aec9-e2739e09ee81"}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:01.193663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:01.201253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:01.201733 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:01.202474 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:01.203210 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:01.203663 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:01.204088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:01.620093 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Invalid volume: volume 5896118d-e7bb-4c9c-aec9-e2739e09ee81 is already attached to instances: e8313736-2707-4a7f-8b8f-2a1a33b07495 Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: POST /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e/os-volume_attachments HTTP/1.1 Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 74 Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:33:01.621845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {"volumeAttachment": {"volumeId": "5896118d-e7bb-4c9c-aec9-e2739e09ee81"}} Sep 23 15:33:01.623467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Invalid volume: volume 5896118d-e7bb-4c9c-aec9-e2739e09ee81 is already attached to instances: e8313736-2707-4a7f-8b8f-2a1a33b07495 Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'server_id': '8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e', 'body': {'volumeAttachment': {'volumeId': '5896118d-e7bb-4c9c-aec9-e2739e09ee81'}}} Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5896118d-e7bb-4c9c-aec9-e2739e09ee81 is already attached to instances: e8313736-2707-4a7f-8b8f-2a1a33b07495 Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:33:01.624396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5896118d-e7bb-4c9c-aec9-e2739e09ee81 is already attached to instances: e8313736-2707-4a7f-8b8f-2a1a33b07495 Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:01.625994 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:01.627905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:01.627905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:01.627905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:01.627905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5896118d-e7bb-4c9c-aec9-e2739e09ee81 is already attached to instances: e8313736-2707-4a7f-8b8f-2a1a33b07495 Sep 23 15:33:01.627905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:33:01.627905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 400 to user: Invalid volume: volume 5896118d-e7bb-4c9c-aec9-e2739e09ee81 is already attached to instances: e8313736-2707-4a7f-8b8f-2a1a33b07495 {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:01.627905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6f51346e-2db0-41ac-a019-0b805f9598f0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.442785 Sep 23 15:33:01.627905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 595/1155] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:33:01 2022] POST /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e/os-volume_attachments => generated 174 bytes in 444 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:33:01.632236 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:01.632772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:01.638758 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:01.639242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:01.640271 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:01.641000 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:01.641451 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:01.641871 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:01.674391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:33:01.757186 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a98a6bdc-4f87-4607-b647-6085466fdb90 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 204 len: 0 microversion: 2.1 time: 0.128386 Sep 23 15:33:01.757646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 561/1156] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:33:01 2022] DELETE /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:33:01.766728 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:01.767568 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:01.776229 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:01.776729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:01.777158 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:01.777846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:01.778285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:01.778697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:01.929455 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:01.937609 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9a0b2db7-5b6c-444e-ab1b-2a489d116877 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1679 microversion: 2.1 time: 0.175613 Sep 23 15:33:01.938180 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 596/1157] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:01 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:02.967135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:02.968256 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:02.975595 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:02.976086 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:02.976527 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:02.977287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:02.977741 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:02.978165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:03.225652 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:03.234174 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d2f9f374-8b22-4cac-8a2e-ca7569a97cfd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1679 microversion: 2.1 time: 0.274328 Sep 23 15:33:03.234719 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 562/1158] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:02 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1679 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:04.258115 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:04.258748 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:04.265681 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:04.266157 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:04.266586 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:04.267280 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:04.267724 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:04.268142 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:04.331048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:04.339809 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d16b497c-8560-427e-ace4-3477681534f6 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1612 microversion: 2.1 time: 0.085549 Sep 23 15:33:04.340389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 597/1159] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:04 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:04.622502 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-c3ce6b4d-1f55-4b85-8c42-44bac8242543 req-89062227-0ebb-42f2-9cb9-6fffb4631cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e", "name": "network-vif-deleted", "tag": "52440fb8-1f32-4aab-a069-1171a8484b8b"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:04.633414 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c3ce6b4d-1f55-4b85-8c42-44bac8242543 req-89062227-0ebb-42f2-9cb9-6fffb4631cf0 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:04.633877 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c3ce6b4d-1f55-4b85-8c42-44bac8242543 req-89062227-0ebb-42f2-9cb9-6fffb4631cf0 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:04.634518 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-c3ce6b4d-1f55-4b85-8c42-44bac8242543 req-89062227-0ebb-42f2-9cb9-6fffb4631cf0 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:04.646313 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-c3ce6b4d-1f55-4b85-8c42-44bac8242543 req-89062227-0ebb-42f2-9cb9-6fffb4631cf0 service nova] Creating event network-vif-deleted:52440fb8-1f32-4aab-a069-1171a8484b8b for instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e on hv-cinder-85501 Sep 23 15:33:04.651692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-c3ce6b4d-1f55-4b85-8c42-44bac8242543 req-89062227-0ebb-42f2-9cb9-6fffb4631cf0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Sep 23 15:33:04.652306 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 563/1160] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:05.364525 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:05.365188 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:05.372228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:05.372753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:05.373192 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:05.374150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:05.374612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:05.375041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:05.437676 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:05.447502 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b684b67a-1b8d-4404-b44d-e04e372d08cd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1612 microversion: 2.1 time: 0.086883 Sep 23 15:33:05.448125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 598/1161] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:05 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1612 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:06.477834 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:06.478984 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:06.489930 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:06.490726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:06.491450 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:06.493016 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:06.493770 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:06.494474 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:06.565100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:06.573211 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-87fd0c04-f40e-4483-90ff-d0c174132e45 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1326 microversion: 2.1 time: 0.103179 Sep 23 15:33:06.573802 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 564/1162] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:06 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:07.598563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:07.599505 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:07.608535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:07.609051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:07.609487 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:07.610185 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:07.610639 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:07.611066 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:07.676488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:07.684828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1a93d383-f818-49d3-b31f-51065c2f1ebb tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 200 len: 1326 microversion: 2.1 time: 0.091897 Sep 23 15:33:07.685392 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 599/1163] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:07 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 1326 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:08.713925 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:08.714542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:08.721672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:08.722157 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:08.722598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:08.723298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:08.723752 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:08.724180 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:08.740134 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e HTTP/1.1 Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:33:08.743114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:33:08.744701 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e'} Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:08.745569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:33:08.747159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:08.748822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:08.748822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-733dfeed-d586-448f-a4c2-843ea1ff7898 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 404 len: 111 microversion: 2.1 time: 0.034634 Sep 23 15:33:08.748822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 565/1164] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:08 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:33:08.754141 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1e8062cf-40df-4a69-b563-6046ebb4cf19 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '.version_select at 0x7fbb03080d30>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:08.776114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1e8062cf-40df-4a69-b563-6046ebb4cf19 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859431465" status: 202 len: 0 microversion: 2.1 time: 0.025809 Sep 23 15:33:08.776709 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 600/1165] 10.222.0.75 () {58 vars in 1218 bytes} [Fri Sep 23 15:33:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859431465 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:33:09.459874 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:09.460365 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:09.466434 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:09.466890 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:09.467528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:09.468312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:09.468881 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:09.469294 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:09.572383 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.objects.instance [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lazy-loading 'services' on Instance uuid e8313736-2707-4a7f-8b8f-2a1a33b07495 {{(pid=120919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:33:09.648765 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-77dc0d4d-3c30-4bdd-a109-f576111402d4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments/5896118d-e7bb-4c9c-aec9-e2739e09ee81" status: 202 len: 0 microversion: 2.1 time: 0.192542 Sep 23 15:33:09.649270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 566/1166] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:33:09 2022] DELETE /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments/5896118d-e7bb-4c9c-aec9-e2739e09ee81 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:33:09.659496 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:09.661707 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:09.668644 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:09.669141 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:09.669580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:09.671475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:09.671916 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:09.672754 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:09.708520 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a8cd6f1a-0d0f-4c13-85d9-99f2a6b146b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054381 Sep 23 15:33:09.709119 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 601/1167] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:33:09 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:10.728200 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:10.732127 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:10.739631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:10.740110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:10.740543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:10.741268 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:10.741718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:10.742508 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:10.775565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-c117b8c9-b32e-464c-9e87-29ebb0635ca0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055763 Sep 23 15:33:10.776112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 567/1168] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:33:10 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:11.792810 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:11.796287 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:11.807345 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:11.808143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:11.808921 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:11.810075 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:11.810818 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:11.811406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:11.841589 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-72556314-5898-4d82-bed6-1dd1c46dbd34 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055655 Sep 23 15:33:11.842258 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 602/1169] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:33:11 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:12.860520 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:12.862696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:12.870112 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:12.870594 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:12.871025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:12.871727 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:12.872171 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:12.872598 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:12.905341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-aaeac570-ac90-4131-aa11-cc75c1221e0f tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050364 Sep 23 15:33:12.905899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 568/1170] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:33:12 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:13.920138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:13.922458 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:13.929562 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:13.930040 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:13.930565 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:13.931418 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:13.931734 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:13.932108 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:13.962899 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b2db721e-6474-47b9-bffe-7d8eed192d6c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Sep 23 15:33:13.963449 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 603/1171] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:33:13 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:33:14.978279 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:14.981761 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:14.991872 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:14.993008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:14.993733 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:14.994816 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:14.995418 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:14.996389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:15.008831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-897073304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1827241209", "security_groups": [{"name": "tempest-secgroup-smoke-132906259"}], "block_device_mapping_v2": [{"uuid": "99973450-fd99-493f-b4ff-924b7a8228d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80722061-916e-4bee-90cb-3ac06c3dce58"}]}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:15.027043 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1bf5ea6e-8c6f-4213-a31e-3c322d2b4de4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055051 Sep 23 15:33:15.027610 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 569/1172] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:33:14 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:33:15.091371 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:15.091785 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:15.098186 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:15.098672 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:15.099101 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:15.099797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:15.100250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:15.100700 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:15.126668 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:33:15.127165 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] validate_networks() for [('80722061-916e-4bee-90cb-3ac06c3dce58', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:33:15.209183 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-952258c7-06b0-4dd8-9d40-617eda7559ec tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 204 len: 0 microversion: 2.1 time: 0.121248 Sep 23 15:33:15.210138 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 570/1173] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:33:15 2022] DELETE /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 15:33:15.220159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:15.220985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:15.227084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:15.227568 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:15.228005 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:15.228789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:15.229243 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:15.229669 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:15.373919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:15.382263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7e7b5f59-b41d-4ce7-a0b8-e7c00e5663b0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1682 microversion: 2.1 time: 0.166750 Sep 23 15:33:15.382848 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 571/1174] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:15 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:15.515905 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:33:15.516519 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:33:15.517227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:33:15.517812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:33:15.518385 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:33:15.531561 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:15.532043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:15.532480 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:15.533210 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:15.533664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:15.534087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:15.551789 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Getting quotas for project c05aa308acb842198935488c659d9ab3. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:33:15.556276 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Getting quotas for user cd5b918b0427408d9a70ca568d75ad58 and project c05aa308acb842198935488c659d9ab3. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:33:15.616387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:33:15.619671 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99973450-fd99-493f-b4ff-924b7a8228d9',volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:33:15.779574 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-573c0436-6407-4472-a04e-635fed9261f3 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.774732 Sep 23 15:33:15.780459 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 604/1175] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:33:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 15:33:15.792293 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b82b666b-982d-4d19-b1ce-349b0b92063b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:15.792960 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b82b666b-982d-4d19-b1ce-349b0b92063b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:15.847406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-b82b666b-982d-4d19-b1ce-349b0b92063b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:15.854712 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b82b666b-982d-4d19-b1ce-349b0b92063b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1094 microversion: 2.1 time: 0.066360 Sep 23 15:33:15.855394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 572/1176] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:15 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:16.409128 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:16.409787 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:16.418122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:16.418683 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:16.419187 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:16.419989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:16.420536 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:16.421041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:16.563483 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:16.571794 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-984bcb95-4e9b-414f-b65a-0ab16c7857a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1682 microversion: 2.1 time: 0.168543 Sep 23 15:33:16.572358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 605/1177] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:16 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:16.878603 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:16.879187 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:16.885842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:16.886621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:16.887193 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:16.887999 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:16.888615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:16.889120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:16.956199 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:16.965790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7ed28b27-9e54-4323-a042-8a51c496d1e5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1192 microversion: 2.1 time: 0.091680 Sep 23 15:33:16.966299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 573/1178] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:16 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:17.596066 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:17.596974 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:17.604541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:17.605296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:17.605887 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:17.606813 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:17.607571 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:17.608110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:17.754120 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:17.762302 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ef79cf2a-6ee5-434f-a87c-8466bce3706a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1682 microversion: 2.1 time: 0.170934 Sep 23 15:33:17.762950 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 606/1179] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:17 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:17.991465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:17.992379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:17.999811 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:18.000371 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:18.000842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:18.001548 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:18.002006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:18.002451 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:18.098739 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:18.106809 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d5f36d9d-83eb-4e06-8456-7e751d2fc42a tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1210 microversion: 2.1 time: 0.119293 Sep 23 15:33:18.107378 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 574/1180] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:17 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:18.786537 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:18.787114 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:18.793849 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:18.794979 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:18.795494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:18.796249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:18.796701 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:18.797150 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:18.866843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:18.885248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9866edf8-8d0a-41ba-8052-87d4f7b6900c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 200 len: 1614 microversion: 2.1 time: 0.100439 Sep 23 15:33:18.886415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 607/1181] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:18 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:18.983210 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-bd436fc6-f80c-495e-9f87-7c441bb41df0 req-57c19ee7-0f55-40c6-92df-37d75650b788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8313736-2707-4a7f-8b8f-2a1a33b07495", "name": "network-vif-deleted", "tag": "7a167ae8-ce16-492c-b9d1-ca2217f95dde"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:18.996617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-bd436fc6-f80c-495e-9f87-7c441bb41df0 req-57c19ee7-0f55-40c6-92df-37d75650b788 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:18.997336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-bd436fc6-f80c-495e-9f87-7c441bb41df0 req-57c19ee7-0f55-40c6-92df-37d75650b788 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:18.997841 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-bd436fc6-f80c-495e-9f87-7c441bb41df0 req-57c19ee7-0f55-40c6-92df-37d75650b788 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:19.013647 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:19.035756 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-bd436fc6-f80c-495e-9f87-7c441bb41df0 req-57c19ee7-0f55-40c6-92df-37d75650b788 service nova] Creating event network-vif-deleted:7a167ae8-ce16-492c-b9d1-ca2217f95dde for instance e8313736-2707-4a7f-8b8f-2a1a33b07495 on hv-cinder-85501 Sep 23 15:33:19.058517 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-bd436fc6-f80c-495e-9f87-7c441bb41df0 req-57c19ee7-0f55-40c6-92df-37d75650b788 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079574 Sep 23 15:33:19.061439 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 575/1182] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:19.130942 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:19.131848 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:19.139010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:19.140163 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:19.140860 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:19.141778 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:19.142434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:19.143333 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:19.580640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:19.595838 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2b418828-44a1-435d-956a-1caafc9476b5 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.469150 Sep 23 15:33:19.597416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 608/1183] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:19 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:19.911758 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:19.912695 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:19.922794 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:19.924027 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:19.925336 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:19.927119 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:19.927759 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:19.928345 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:19.953569 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 HTTP/1.1 Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:33:19.955419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:33:19.957334 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'e8313736-2707-4a7f-8b8f-2a1a33b07495'} Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:33:19.958308 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:33:19.959801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:33:19.961120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:33:19.961120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4f02eaa1-2626-44df-ad54-c7f2b1062768 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 404 len: 111 microversion: 2.1 time: 0.049966 Sep 23 15:33:19.967542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-520ee154-3e0c-4879-a4b3-37bcd060fe79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '.version_select at 0x7fbb02ffd5e0>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:19.968981 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 576/1184] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:19 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:33:19.992278 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-520ee154-3e0c-4879-a4b3-37bcd060fe79 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541621410" status: 202 len: 0 microversion: 2.1 time: 0.028942 Sep 23 15:33:19.992987 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 609/1185] 10.222.0.75 () {58 vars in 1218 bytes} [Fri Sep 23 15:33:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541621410 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:33:20.620985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:20.621729 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:20.628532 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:20.629124 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:20.629618 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:20.630402 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:20.630919 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:20.631398 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:20.885362 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:20.896458 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-9c0e5147-8cd5-470c-ada5-48e34a6400a9 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.279497 Sep 23 15:33:20.897369 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 577/1186] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:20 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:21.017158 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7263e915-710f-411d-ade8-8e1dfd395db9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: .version_select at 0x7fbb030c4b80>, body: {"keypair": {"name": "tempest-keypair-1389564021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoKLQShHA43n6xda4Y6iLNRG3goJe2X0ZrbmUgTQu7KZKg/KoNs+55svj3sKiRaA35W5aVnB4ump3BV7Y76VQNlyDb6EMpArOXti3eDJZUZwwa0K+Y5y0ySZuvbPCpyhg=="}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:21.035770 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-7263e915-710f-411d-ade8-8e1dfd395db9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:33:21.039717 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-7263e915-710f-411d-ade8-8e1dfd395db9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for user 338a34cb85d7455a9bed32158d4f9497 and project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'key_pairs'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:33:21.064155 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7263e915-710f-411d-ade8-8e1dfd395db9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051104 Sep 23 15:33:21.064765 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 610/1187] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:33:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:21.079724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-6cab3795-8fe7-4d41-927f-ab11d43bf9ad req-6ec805ef-8b63-4ed9-ac0b-234f9236ce6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39100324-7ac5-4a83-8822-9af1c2309671", "tag": "4b2b057f-9815-454d-a83b-9f55310e7e7a"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:21.089444 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-6cab3795-8fe7-4d41-927f-ab11d43bf9ad req-6ec805ef-8b63-4ed9-ac0b-234f9236ce6d service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:21.090168 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-6cab3795-8fe7-4d41-927f-ab11d43bf9ad req-6ec805ef-8b63-4ed9-ac0b-234f9236ce6d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:21.090767 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-6cab3795-8fe7-4d41-927f-ab11d43bf9ad req-6ec805ef-8b63-4ed9-ac0b-234f9236ce6d service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:21.103521 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-6cab3795-8fe7-4d41-927f-ab11d43bf9ad req-6ec805ef-8b63-4ed9-ac0b-234f9236ce6d service nova] Creating event network-changed:4b2b057f-9815-454d-a83b-9f55310e7e7a for instance 39100324-7ac5-4a83-8822-9af1c2309671 on hv-cinder-85501 Sep 23 15:33:21.109142 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-6cab3795-8fe7-4d41-927f-ab11d43bf9ad req-6ec805ef-8b63-4ed9-ac0b-234f9236ce6d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033226 Sep 23 15:33:21.109772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 578/1188] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:21.922020 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:21.923898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:21.939755 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:21.940476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:21.941106 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:21.942694 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:21.944189 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:21.944827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:22.238914 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:22.249293 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-f3fab9ee-71a2-4a93-9f7e-b5c858390ff7 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.332029 Sep 23 15:33:22.250012 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 611/1189] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:21 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:22.508255 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1936611780", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62392971-b242-4d1a-af09-6b426905b68b"}], "security_groups": [{"name": "tempest-securitygroup--1594511361"}], "key_name": "tempest-keypair-1389564021", "user_data": "}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:22.639529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.network.neutron [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] validate_networks() for [('62392971-b242-4d1a-af09-6b426905b68b', None, None, None, None, None)] {{(pid=120919) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:33:23.041041 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Flavor limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:33:23.041721 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Image limits 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:33:23.042537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Flavor pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:33:23.043179 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Image pref 0:0:0 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:33:23.043838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.virt.hardware [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:33:23.055639 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:23.056118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:23.056534 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:23.057300 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:23.057779 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:23.058209 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:23.075494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:33:23.079797 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for user 338a34cb85d7455a9bed32158d4f9497 and project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:33:23.091261 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Going to run 1 instances... {{(pid=120919) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:33:23.093814 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:33:23.148326 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e217cd4d-5ea4-4a55-8799-61971dee22d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.644862 Sep 23 15:33:23.149001 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 579/1190] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:33:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:33:23.160641 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c2559645-123e-4fba-a270-c5c6188f5bc3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:23.161251 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c2559645-123e-4fba-a270-c5c6188f5bc3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:23.215579 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c2559645-123e-4fba-a270-c5c6188f5bc3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:23.223297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c2559645-123e-4fba-a270-c5c6188f5bc3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1242 microversion: 2.1 time: 0.066593 Sep 23 15:33:23.223841 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 612/1191] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:23 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:23.271537 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:23.272157 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:23.278571 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:23.279056 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:23.279491 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:23.280360 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:23.280734 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:23.281231 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:23.430006 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:23.439159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-775aa790-5248-4d74-8e57-736f5f2e5d18 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.171625 Sep 23 15:33:23.439829 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 580/1192] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:23 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:24.247386 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:24.248050 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:24.256358 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:24.256873 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:24.257341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:24.258270 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:24.258804 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:24.259255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:24.330444 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:24.341478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d6ec9449-be85-47db-8604-39e7137e045e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1302 microversion: 2.1 time: 0.099233 Sep 23 15:33:24.342110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 613/1193] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:24 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1302 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:24.462415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:24.463017 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:24.470123 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:24.470603 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:24.471037 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:24.471729 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:24.472178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:24.472631 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:24.679897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:24.688250 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6956bc19-ee2e-4275-a776-c57593d0a416 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.229676 Sep 23 15:33:24.688867 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 581/1194] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:24 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:25.365085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:25.365631 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:25.372532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:25.373043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:25.373475 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:25.374179 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:25.374738 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:25.375154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:25.508046 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:25.515917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-48db696f-f9bf-47b7-9ea2-087733c45aba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1368 microversion: 2.1 time: 0.154885 Sep 23 15:33:25.516489 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 614/1195] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:25 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:25.711681 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:25.713040 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:25.720344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:25.720855 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:25.721293 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:25.721995 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:25.722469 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:25.722900 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:25.917666 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-d7f1e9e2-81eb-4e9c-b5e7-3133da67faed req-d8339e75-f62c-4ecf-b91e-46123924b887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1d775a-2566-40d4-a176-e03fc58b803e", "tag": "1ecca428-35ab-459e-b0d1-d3d8dbcab9e7"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:25.922715 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:25.928783 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-d7f1e9e2-81eb-4e9c-b5e7-3133da67faed req-d8339e75-f62c-4ecf-b91e-46123924b887 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:25.929255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-d7f1e9e2-81eb-4e9c-b5e7-3133da67faed req-d8339e75-f62c-4ecf-b91e-46123924b887 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:25.929679 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-d7f1e9e2-81eb-4e9c-b5e7-3133da67faed req-d8339e75-f62c-4ecf-b91e-46123924b887 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:25.939775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:25.948382 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-35d59a3d-3c70-44e5-89d8-b4442a58f3dd tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.240588 Sep 23 15:33:25.949205 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 582/1196] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:25 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:25.966407 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-d7f1e9e2-81eb-4e9c-b5e7-3133da67faed req-d8339e75-f62c-4ecf-b91e-46123924b887 service nova] Creating event network-changed:1ecca428-35ab-459e-b0d1-d3d8dbcab9e7 for instance 3e1d775a-2566-40d4-a176-e03fc58b803e on hv-cinder-85501 Sep 23 15:33:25.972948 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-d7f1e9e2-81eb-4e9c-b5e7-3133da67faed req-d8339e75-f62c-4ecf-b91e-46123924b887 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059173 Sep 23 15:33:25.973601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 615/1197] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:26.543287 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:26.544554 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:26.551809 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:26.552297 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:26.552772 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:26.553475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:26.553935 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:26.554394 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:26.970200 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:26.972259 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:26.972992 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:26.978238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-8effd927-15d4-4375-8b97-77d5d1747683 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1368 microversion: 2.1 time: 0.441244 Sep 23 15:33:26.978817 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 583/1198] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:26 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1368 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:26.980096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:26.980580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:26.981043 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:26.981744 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:26.982195 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:26.982655 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:27.123718 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:27.128830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=100 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:27.136026 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c6aa872e-4617-46e4-85eb-6329403181b1 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.167965 Sep 23 15:33:27.136940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 616/1199] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:26 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:28.005755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:28.006776 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:28.016836 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:28.017315 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:28.017768 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:28.018426 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:28.018870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:28.019288 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:28.149941 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:28.158298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7c7119a3-7bab-418a-b220-d90b1eb1893e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1368 microversion: 2.1 time: 0.159147 Sep 23 15:33:28.158836 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 584/1200] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:27 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:28.160161 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:28.160886 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:28.167753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:28.168243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:28.168722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:28.169495 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:28.169956 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:28.170389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:28.307017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:28.315433 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5af10ac8-a5a1-44a6-9637-c54d97afbf43 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.159988 Sep 23 15:33:28.316006 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 617/1201] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:28 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:29.185990 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:29.187089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:29.194089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:29.194575 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:29.195013 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:29.195711 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:29.196167 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:29.196637 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:29.338400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:29.339144 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:29.339798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:29.346434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:29.346922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:29.347352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:29.347513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4295de11-67fb-4267-9124-6b2c255b897e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1368 microversion: 2.1 time: 0.168078 Sep 23 15:33:29.347980 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 585/1202] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:29 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:29.348245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:29.349294 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:29.349721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:29.485549 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:29.494087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-35ffbb4e-23af-4f21-8f4b-c3373ccc1f92 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.158956 Sep 23 15:33:29.494868 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 618/1203] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:29 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:30.371226 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:30.371800 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:30.378913 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:30.379391 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:30.379820 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:30.380507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:30.380986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:30.381438 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:30.511483 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:30.517774 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:30.518306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:30.521573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-eebc6733-59b6-4252-895c-0bfe413e2e55 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1368 microversion: 2.1 time: 0.154544 Sep 23 15:33:30.522144 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 586/1204] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:30 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:30.525127 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:30.525654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:30.526087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:30.526795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:30.527248 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:30.527646 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:30.670001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:30.681674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-d066d226-15c6-43a8-9498-26c0d069b73e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.168117 Sep 23 15:33:30.682616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 619/1205] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:30 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:31.547459 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:31.548640 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:31.551202 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:31.557163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:31.557595 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:31.558032 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:31.559003 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:31.559437 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:31.559884 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:31.694718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:31.702593 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dab377c6-6d46-42cd-86e2-e1c60aa23655 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1368 microversion: 2.1 time: 0.161605 Sep 23 15:33:31.703220 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 587/1206] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:31 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:31.705659 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:31.706486 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:31.708942 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:31.715296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:31.715798 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:31.716379 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:31.717142 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:31.717626 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:31.718055 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:31.865781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:31.874289 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-81304749-af72-40fc-8052-6179aa1dc0a0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.172869 Sep 23 15:33:31.875303 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 620/1207] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:31 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:32.727048 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:32.727859 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:32.734660 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:32.735498 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:32.735929 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:32.736699 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:32.737184 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:32.737602 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:32.740903 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-af280c8f-03cb-47c2-8313-4881ed19ff0b req-0fc445a0-0b28-44ce-8771-e1edb03d6145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d775a-2566-40d4-a176-e03fc58b803e", "name": "network-vif-plugged", "status": "completed", "tag": "1ecca428-35ab-459e-b0d1-d3d8dbcab9e7"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:32.753477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-af280c8f-03cb-47c2-8313-4881ed19ff0b req-0fc445a0-0b28-44ce-8771-e1edb03d6145 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:32.754010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-af280c8f-03cb-47c2-8313-4881ed19ff0b req-0fc445a0-0b28-44ce-8771-e1edb03d6145 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:32.754402 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-af280c8f-03cb-47c2-8313-4881ed19ff0b req-0fc445a0-0b28-44ce-8771-e1edb03d6145 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:32.770336 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-af280c8f-03cb-47c2-8313-4881ed19ff0b req-0fc445a0-0b28-44ce-8771-e1edb03d6145 service nova] Creating event network-vif-plugged:1ecca428-35ab-459e-b0d1-d3d8dbcab9e7 for instance 3e1d775a-2566-40d4-a176-e03fc58b803e on hv-cinder-85501 Sep 23 15:33:32.776935 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-af280c8f-03cb-47c2-8313-4881ed19ff0b req-0fc445a0-0b28-44ce-8771-e1edb03d6145 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039688 Sep 23 15:33:32.777552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 621/1208] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:32.885674 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:32.895344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6a2f1327-35f2-4e9f-b70d-eb98e291ff29 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1368 microversion: 2.1 time: 0.172777 Sep 23 15:33:32.898729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:32.899627 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:32.906805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:32.907612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:32.908211 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:32.909265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:32.909891 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:32.910118 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 588/1209] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:32 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:32.910721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:33.055679 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:33.064305 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-719a9e9c-c4a8-46c2-a762-5e33778566f0 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.170661 Sep 23 15:33:33.064915 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 622/1210] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:32 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:33.924331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:33.925019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:33.926949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:33.927604 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=8 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:33.933744 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:33.934222 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:33.934655 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:33.935353 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:33.935804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:33.936223 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:34.086919 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:34.087569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:34.089536 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=12 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:34.095934 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:34.096110 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:34.096445 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:34.096906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:34.097606 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:34.098052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:34.098469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:34.104270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-018d437a-4242-4811-98cf-d912ddfc58c0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1368 microversion: 2.1 time: 0.185037 Sep 23 15:33:34.104862 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 589/1211] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:33 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:34.243561 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:34.253926 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ead9cdf1-a799-4cf3-b22e-cd231ee89948 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.170955 Sep 23 15:33:34.254542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 623/1212] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:34 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:34.813599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-0e181b7b-bc69-465e-81ce-c0b9643ddd0c req-98386f73-68ce-4492-92e3-ceb84fada78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39100324-7ac5-4a83-8822-9af1c2309671", "name": "network-vif-plugged", "status": "completed", "tag": "4b2b057f-9815-454d-a83b-9f55310e7e7a"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:34.828371 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-0e181b7b-bc69-465e-81ce-c0b9643ddd0c req-98386f73-68ce-4492-92e3-ceb84fada78f service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:34.829110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-0e181b7b-bc69-465e-81ce-c0b9643ddd0c req-98386f73-68ce-4492-92e3-ceb84fada78f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:34.829561 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-0e181b7b-bc69-465e-81ce-c0b9643ddd0c req-98386f73-68ce-4492-92e3-ceb84fada78f service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:34.843522 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-0e181b7b-bc69-465e-81ce-c0b9643ddd0c req-98386f73-68ce-4492-92e3-ceb84fada78f service nova] Creating event network-vif-plugged:4b2b057f-9815-454d-a83b-9f55310e7e7a for instance 39100324-7ac5-4a83-8822-9af1c2309671 on hv-cinder-85501 Sep 23 15:33:34.849137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-0e181b7b-bc69-465e-81ce-c0b9643ddd0c req-98386f73-68ce-4492-92e3-ceb84fada78f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041420 Sep 23 15:33:34.849726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 590/1213] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:35.128329 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:35.129010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:35.135945 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:35.136434 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:35.136904 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:35.137612 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:35.138067 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:35.138498 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:35.268675 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:35.276975 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-640ca0b4-9af7-4355-b215-37c0c594580d tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1557 microversion: 2.1 time: 0.152654 Sep 23 15:33:35.277580 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 624/1214] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:35 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:35.278151 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:35.278932 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:35.286077 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:35.286580 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:35.286979 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:35.287661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:35.288102 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:35.288513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:35.299147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:35.299625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:35.305862 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:35.306353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:35.307295 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:35.307456 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:35.307933 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:35.308364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:35.387870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6d770a49-ddc1-4334-af6b-b7c694f93076 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092595 Sep 23 15:33:35.388611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 625/1215] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Sep 23 15:33:35 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:35.427216 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:35.435150 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ea946ee3-dd8c-4c70-94c3-0e2e802b3d1d tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.161207 Sep 23 15:33:35.435722 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 591/1216] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:35 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:36.373782 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-f92fca42-ab0e-4242-8890-6c1c7826ec2e req-5d11162a-4994-47ff-ade5-9e2639adbd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1d775a-2566-40d4-a176-e03fc58b803e", "tag": "1ecca428-35ab-459e-b0d1-d3d8dbcab9e7"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:36.383422 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f92fca42-ab0e-4242-8890-6c1c7826ec2e req-5d11162a-4994-47ff-ade5-9e2639adbd03 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:36.383891 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f92fca42-ab0e-4242-8890-6c1c7826ec2e req-5d11162a-4994-47ff-ade5-9e2639adbd03 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:36.384316 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f92fca42-ab0e-4242-8890-6c1c7826ec2e req-5d11162a-4994-47ff-ade5-9e2639adbd03 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:36.395476 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-f92fca42-ab0e-4242-8890-6c1c7826ec2e req-5d11162a-4994-47ff-ade5-9e2639adbd03 service nova] Creating event network-changed:1ecca428-35ab-459e-b0d1-d3d8dbcab9e7 for instance 3e1d775a-2566-40d4-a176-e03fc58b803e on hv-cinder-85501 Sep 23 15:33:36.400637 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-f92fca42-ab0e-4242-8890-6c1c7826ec2e req-5d11162a-4994-47ff-ade5-9e2639adbd03 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Sep 23 15:33:36.401304 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 626/1217] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:33:36.459315 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:36.460020 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:36.467292 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:36.467811 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:36.477052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:36.478475 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:36.479102 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:36.479915 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:36.618351 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:36.626625 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f418c819-c034-4f6a-a0ca-34fa31c17942 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1265 microversion: 2.1 time: 0.172069 Sep 23 15:33:36.627347 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 592/1218] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:36 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:37.652522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:37.653340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:37.660958 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:37.661479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:37.661967 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:37.662779 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:37.663285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:37.663762 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:37.814081 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:37.826652 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c81a13f5-6864-4a3c-9233-dff763c28327 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1453 microversion: 2.1 time: 0.179156 Sep 23 15:33:37.827532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 627/1219] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:37 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:37.850679 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:33:37.851268 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:33:37.858147 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:37.858635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:37.859159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:37.859830 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:37.860314 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:37.860775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:38.004726 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:33:38.012780 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f4cd9ad8-c4e0-4173-92fb-96ca9bc8a4e4 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1453 microversion: 2.1 time: 0.166098 Sep 23 15:33:38.013370 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 593/1220] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:33:37 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:33:39.785029 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-81b12850-d377-43c3-87ff-94c2a4ad05f5 req-a6fb9d28-3c26-4484-87dd-d225df549da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39100324-7ac5-4a83-8822-9af1c2309671", "tag": "4b2b057f-9815-454d-a83b-9f55310e7e7a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:33:39.798691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-81b12850-d377-43c3-87ff-94c2a4ad05f5 req-a6fb9d28-3c26-4484-87dd-d225df549da5 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:33:39.799085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-81b12850-d377-43c3-87ff-94c2a4ad05f5 req-a6fb9d28-3c26-4484-87dd-d225df549da5 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:33:39.799506 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-81b12850-d377-43c3-87ff-94c2a4ad05f5 req-a6fb9d28-3c26-4484-87dd-d225df549da5 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:33:39.811375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-81b12850-d377-43c3-87ff-94c2a4ad05f5 req-a6fb9d28-3c26-4484-87dd-d225df549da5 service nova] Creating event network-changed:4b2b057f-9815-454d-a83b-9f55310e7e7a for instance 39100324-7ac5-4a83-8822-9af1c2309671 on hv-cinder-85501 Sep 23 15:33:39.817064 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-81b12850-d377-43c3-87ff-94c2a4ad05f5 req-a6fb9d28-3c26-4484-87dd-d225df549da5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035976 Sep 23 15:33:39.817654 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 628/1221] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:34:50.425210 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=13 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:50.426153 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=92 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:50.494263 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:50.494751 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:50.505762 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:50.506389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:50.507012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:50.508073 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:50.508779 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:50.509403 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:50.535683 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-6b805b07-f7fe-4d81-90de-a30eabdbe7d8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/ips" status: 200 len: 149 microversion: 2.1 time: 0.112654 Sep 23 15:34:50.536130 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 594/1222] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:34:50 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/ips => generated 149 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:34:51.888098 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=17 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:51.889059 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=58 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:51.894842 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06041109-1dde-4b68-8b18-255be49d47fa"}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:34:51.897296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:51.904911 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:51.905393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:51.905837 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:51.906531 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:51.906977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:51.907403 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:52.206650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-6ab501a3-e490-4e8a-8e61-cee4cf6e1dba tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321788 Sep 23 15:34:52.207310 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 629/1223] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:34:51 2022] POST /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:34:59.814088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06041109-1dde-4b68-8b18-255be49d47fa"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:34:59.816564 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:59.823282 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:59.823802 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:59.824242 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:59.824972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:59.825433 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:59.825856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:59.910074 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Invalid volume: volume 06041109-1dde-4b68-8b18-255be49d47fa is already attached to instances: 3e1d775a-2566-40d4-a176-e03fc58b803e Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: POST /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments HTTP/1.1 Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 74 Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:34:59.911804 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {"volumeAttachment": {"volumeId": "06041109-1dde-4b68-8b18-255be49d47fa"}} Sep 23 15:34:59.913516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Invalid volume: volume 06041109-1dde-4b68-8b18-255be49d47fa is already attached to instances: 3e1d775a-2566-40d4-a176-e03fc58b803e Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'server_id': '3e1d775a-2566-40d4-a176-e03fc58b803e', 'body': {'volumeAttachment': {'volumeId': '06041109-1dde-4b68-8b18-255be49d47fa'}}} Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06041109-1dde-4b68-8b18-255be49d47fa is already attached to instances: 3e1d775a-2566-40d4-a176-e03fc58b803e Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:34:59.914806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06041109-1dde-4b68-8b18-255be49d47fa is already attached to instances: 3e1d775a-2566-40d4-a176-e03fc58b803e Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:34:59.916507 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:34:59.918318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:34:59.918318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:34:59.918318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:34:59.918318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06041109-1dde-4b68-8b18-255be49d47fa is already attached to instances: 3e1d775a-2566-40d4-a176-e03fc58b803e Sep 23 15:34:59.918318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:34:59.918318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 400 to user: Invalid volume: volume 06041109-1dde-4b68-8b18-255be49d47fa is already attached to instances: 3e1d775a-2566-40d4-a176-e03fc58b803e {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:34:59.918318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-a74fa361-227a-4b53-86fb-7f6c89ddc5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104918 Sep 23 15:34:59.918318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 595/1224] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:34:59 2022] POST /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 15:34:59.988552 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:34:59.989145 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:34:59.996051 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:59.996529 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:59.997005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:34:59.997696 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:34:59.998143 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:34:59.998532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:00.087245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lazy-loading 'services' on Instance uuid 3e1d775a-2566-40d4-a176-e03fc58b803e {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:35:00.179308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1f765d00-571c-43a5-9143-be2ba9e655d0 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments/06041109-1dde-4b68-8b18-255be49d47fa" status: 202 len: 0 microversion: 2.1 time: 0.195963 Sep 23 15:35:00.179889 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 630/1225] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:34:59 2022] DELETE /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments/06041109-1dde-4b68-8b18-255be49d47fa => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:35:00.189750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:00.191918 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:00.199703 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:00.200191 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:00.201337 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:00.202156 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:00.202750 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:00.204090 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:00.235238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-0d30720b-4ab5-4f6a-bd94-dafeab657392 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050802 Sep 23 15:35:00.235789 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 596/1226] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:35:00 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:35:01.252417 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:01.254799 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:01.261154 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:01.261628 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:01.262050 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:01.262739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:01.263178 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:01.263588 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:01.292850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7da7ec94-77aa-4d97-ae27-007866f4c4f7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048476 Sep 23 15:35:01.293313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 631/1227] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:35:01 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 15:35:01.358974 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:01.359533 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:01.367137 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:01.367624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:01.368114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:01.368856 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:01.369311 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:01.369737 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:01.397844 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:35:01.480323 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-30ccc81e-8d4a-4809-9f49-dc39295ac941 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 204 len: 0 microversion: 2.1 time: 0.124958 Sep 23 15:35:01.481314 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 597/1228] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:35:01 2022] DELETE /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:35:01.489767 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:01.490379 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:01.496858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:01.497340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:01.497771 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:01.498468 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:01.498917 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:01.499341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:01.649202 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:01.657569 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b9d5b2bc-8e03-45dd-bc1c-38d9a2cd05bd tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1682 microversion: 2.1 time: 0.171796 Sep 23 15:35:01.658135 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 632/1229] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:01 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:02.682806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:02.683464 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:02.690607 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:02.691085 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:02.691513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:02.692206 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:02.692654 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:02.693089 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:02.847158 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:02.858621 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-078a9f60-9eda-46d0-a171-7be984413670 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1682 microversion: 2.1 time: 0.180325 Sep 23 15:35:02.859309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 598/1230] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:02 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:03.888628 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:03.889266 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:03.896995 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:03.897485 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:03.897922 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:03.898601 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:03.899089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:03.899515 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:04.030723 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:04.039337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-eb64a444-0e14-43e6-a91e-b955988cf2d3 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1682 microversion: 2.1 time: 0.154734 Sep 23 15:35:04.039898 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 633/1231] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:03 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:04.440306 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-99bd57b1-7d13-405b-899f-cbe9df7159b3 req-255e4b54-f588-4c79-866e-4d5ec1fb0f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d775a-2566-40d4-a176-e03fc58b803e", "name": "network-vif-deleted", "tag": "1ecca428-35ab-459e-b0d1-d3d8dbcab9e7"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:04.453270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-99bd57b1-7d13-405b-899f-cbe9df7159b3 req-255e4b54-f588-4c79-866e-4d5ec1fb0f51 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:04.453720 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-99bd57b1-7d13-405b-899f-cbe9df7159b3 req-255e4b54-f588-4c79-866e-4d5ec1fb0f51 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:04.454599 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-99bd57b1-7d13-405b-899f-cbe9df7159b3 req-255e4b54-f588-4c79-866e-4d5ec1fb0f51 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:04.479073 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-99bd57b1-7d13-405b-899f-cbe9df7159b3 req-255e4b54-f588-4c79-866e-4d5ec1fb0f51 service nova] Creating event network-vif-deleted:1ecca428-35ab-459e-b0d1-d3d8dbcab9e7 for instance 3e1d775a-2566-40d4-a176-e03fc58b803e on hv-cinder-85501 Sep 23 15:35:04.487319 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-99bd57b1-7d13-405b-899f-cbe9df7159b3 req-255e4b54-f588-4c79-866e-4d5ec1fb0f51 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052452 Sep 23 15:35:04.487910 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 599/1232] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:35:05.064161 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:05.064812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:05.071470 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:05.071953 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:05.072380 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:05.073184 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:05.073700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:05.074426 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:05.107982 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:05.108469 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:05.108946 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:05.109399 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lazy-loading 'fault' on Instance uuid 3e1d775a-2566-40d4-a176-e03fc58b803e {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:35:05.152285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:05.159799 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1c245fe8-8c45-48e0-8a3f-cde6ba0ff162 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 200 len: 1332 microversion: 2.1 time: 0.100215 Sep 23 15:35:05.160835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 634/1233] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:05 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:06.190790 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:06.191982 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:06.202565 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:06.203372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:06.204091 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:06.205298 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:06.205756 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:06.206178 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:06.219673 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e HTTP/1.1 Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:35:06.221696 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:35:06.223344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '3e1d775a-2566-40d4-a176-e03fc58b803e'} Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:35:06.224400 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:35:06.226055 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:06.227895 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:35:06.227895 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1f0ee32f-587f-4d89-9e63-3e50964e41b7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 404 len: 111 microversion: 2.1 time: 0.040238 Sep 23 15:35:06.227895 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 600/1234] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:06 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:35:06.232111 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-be898dfb-df28-4385-9b44-f968a0cb217c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '.version_select at 0x7fbb0300c700>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:06.255702 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-be898dfb-df28-4385-9b44-f968a0cb217c tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389564021" status: 202 len: 0 microversion: 2.1 time: 0.027501 Sep 23 15:35:06.256232 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 635/1235] 10.222.0.75 () {58 vars in 1221 bytes} [Fri Sep 23 15:35:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1389564021 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:35:06.939470 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-dbb9f00b-6947-4cd1-8187-6052a83c1951 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: .version_select at 0x7fbb030774c0>, body: {"keypair": {"name": "tempest-keypair-387716221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbljHVwIj7geNCWTHa2ECSpn88jUThfi3/KbgkBeCtY37fASmdmoCPoowVO+BaU4gYvK4M3bUizCk2zjZ/9TL95MG142siK0yGohc94HjVt/cKK8XnneokVT1dgcTfFSQ=="}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:06.956837 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-dbb9f00b-6947-4cd1-8187-6052a83c1951 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:35:06.960986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.quota [None req-dbb9f00b-6947-4cd1-8187-6052a83c1951 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for user 338a34cb85d7455a9bed32158d4f9497 and project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'key_pairs'} {{(pid=120919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:35:06.990567 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-dbb9f00b-6947-4cd1-8187-6052a83c1951 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055158 Sep 23 15:35:06.991529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 601/1236] 10.222.0.75 () {60 vars in 1159 bytes} [Fri Sep 23 15:35:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:35:08.525566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-390916033", "imageRef": "1e320b3d-e1ee-4dca-b292-4f7026fa9129", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62392971-b242-4d1a-af09-6b426905b68b"}], "security_groups": [{"name": "tempest-securitygroup--660566809"}], "key_name": "tempest-keypair-387716221", "user_data": "}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:08.634674 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.network.neutron [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] validate_networks() for [('62392971-b242-4d1a-af09-6b426905b68b', None, None, None, None, None)] {{(pid=120918) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 15:35:09.023924 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Flavor limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 15:35:09.024478 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Image limits 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 15:35:09.025226 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Flavor pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 15:35:09.025795 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Image pref 0:0:0 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 15:35:09.026409 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.virt.hardware [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 15:35:09.041437 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:09.042121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:09.042700 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:09.043894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:09.044547 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:09.045122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:09.064544 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 15:35:09.069207 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.quota [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Getting quotas for user 338a34cb85d7455a9bed32158d4f9497 and project 58f43b3aab03420bbcb0a2b0f7a338ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 15:35:09.082133 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Going to run 1 instances... {{(pid=120918) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 15:35:09.084479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e320b3d-e1ee-4dca-b292-4f7026fa9129',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 15:35:09.145975 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1f073c3c-59f4-424f-90e7-fbdfa0c7d9fc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.626483 Sep 23 15:35:09.146706 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 636/1237] 10.222.0.75 () {60 vars in 1147 bytes} [Fri Sep 23 15:35:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 15:35:09.158182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4c281699-3e55-45cd-a5bb-407584c887ed tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:09.158961 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4c281699-3e55-45cd-a5bb-407584c887ed tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:09.217335 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-4c281699-3e55-45cd-a5bb-407584c887ed tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:09.224529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4c281699-3e55-45cd-a5bb-407584c887ed tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1240 microversion: 2.1 time: 0.070319 Sep 23 15:35:09.225114 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 602/1238] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:09 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:10.248747 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:10.249387 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:10.257034 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:10.257515 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:10.257940 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:10.258632 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:10.259077 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:10.259494 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:10.323467 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:10.334964 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-9bd60083-a54e-4ea0-ba14-9d51e6d05779 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1292 microversion: 2.1 time: 0.090494 Sep 23 15:35:10.335845 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 637/1239] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:10 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:11.361348 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:11.361991 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:11.369312 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:11.369806 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:11.370238 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:11.370932 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:11.371377 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:11.371809 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:11.576240 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:11.585009 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-20e7aca0-d1c0-405b-9e73-ef119b2991e8 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1365 microversion: 2.1 time: 0.227466 Sep 23 15:35:11.585573 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 603/1240] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:11 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:12.115308 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-6fdc383b-c305-40b4-8d3a-f02fe2d94bec req-f6df0b6b-6cd2-4ef0-865b-29ddfda0d422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea1469c-a93c-4f28-9dc2-10168aa75991", "tag": "19763998-2ae2-48ae-9b03-3d196f0be1a2"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:12.127213 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-6fdc383b-c305-40b4-8d3a-f02fe2d94bec req-f6df0b6b-6cd2-4ef0-865b-29ddfda0d422 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:12.127797 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-6fdc383b-c305-40b4-8d3a-f02fe2d94bec req-f6df0b6b-6cd2-4ef0-865b-29ddfda0d422 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:12.128415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-6fdc383b-c305-40b4-8d3a-f02fe2d94bec req-f6df0b6b-6cd2-4ef0-865b-29ddfda0d422 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:12.140147 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-6fdc383b-c305-40b4-8d3a-f02fe2d94bec req-f6df0b6b-6cd2-4ef0-865b-29ddfda0d422 service nova] Creating event network-changed:19763998-2ae2-48ae-9b03-3d196f0be1a2 for instance aea1469c-a93c-4f28-9dc2-10168aa75991 on hv-cinder-85501 Sep 23 15:35:12.145253 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-6fdc383b-c305-40b4-8d3a-f02fe2d94bec req-f6df0b6b-6cd2-4ef0-865b-29ddfda0d422 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033906 Sep 23 15:35:12.145930 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 638/1241] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:35:12.607704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:12.608342 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:12.615421 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:12.615870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:12.616661 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:12.617352 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:12.617795 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:12.618211 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:12.758148 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:12.766350 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1887c05e-4f99-44cc-a284-6cddd4a8778e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1365 microversion: 2.1 time: 0.162596 Sep 23 15:35:12.766894 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 604/1242] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:12 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:13.794886 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:13.796060 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:13.806840 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:13.807541 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:13.808319 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:13.809507 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:13.810285 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:13.810989 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:13.948980 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:13.958625 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cb8615b4-9e68-4e70-9d7d-83e515aa2840 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1365 microversion: 2.1 time: 0.171680 Sep 23 15:35:13.959200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 639/1243] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:13 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:14.981954 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:14.982529 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:14.989460 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:14.990058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:14.990514 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:14.991542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:14.991987 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:14.992406 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:15.279870 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:15.289365 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-1fee1ca3-45a1-47cb-b70d-f42083d8d020 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1365 microversion: 2.1 time: 0.311291 Sep 23 15:35:15.290251 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 605/1244] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:14 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:16.318048 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:16.319341 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:16.330196 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:16.331002 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:16.331729 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:16.332928 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:16.333706 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:16.334246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:16.484847 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:16.493965 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7b5ac0bc-44c5-456f-a184-48d46b03d48b tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1365 microversion: 2.1 time: 0.182620 Sep 23 15:35:16.494542 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 640/1245] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:16 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:16.761704 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-0032a5a7-e2f5-45f8-8fcc-a6da812901e9 req-79d00b75-4c4d-41a3-859a-7fa992692070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea1469c-a93c-4f28-9dc2-10168aa75991", "name": "network-vif-plugged", "status": "completed", "tag": "19763998-2ae2-48ae-9b03-3d196f0be1a2"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:16.771300 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-0032a5a7-e2f5-45f8-8fcc-a6da812901e9 req-79d00b75-4c4d-41a3-859a-7fa992692070 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:16.771761 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-0032a5a7-e2f5-45f8-8fcc-a6da812901e9 req-79d00b75-4c4d-41a3-859a-7fa992692070 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:16.772182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-0032a5a7-e2f5-45f8-8fcc-a6da812901e9 req-79d00b75-4c4d-41a3-859a-7fa992692070 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:16.783071 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-0032a5a7-e2f5-45f8-8fcc-a6da812901e9 req-79d00b75-4c4d-41a3-859a-7fa992692070 service nova] Creating event network-vif-plugged:19763998-2ae2-48ae-9b03-3d196f0be1a2 for instance aea1469c-a93c-4f28-9dc2-10168aa75991 on hv-cinder-85501 Sep 23 15:35:16.788355 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-0032a5a7-e2f5-45f8-8fcc-a6da812901e9 req-79d00b75-4c4d-41a3-859a-7fa992692070 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090661 Sep 23 15:35:16.789004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 606/1246] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:35:17.518271 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:17.518957 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:17.530678 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:17.531615 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:17.532353 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:17.533416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:17.533920 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:17.534395 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:17.673010 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:17.680753 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-c73c18c4-cefb-4e1b-8569-a4a82d569ae7 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1365 microversion: 2.1 time: 0.166854 Sep 23 15:35:17.681297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 641/1247] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:17 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:18.708926 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:18.709657 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:18.716791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:18.717300 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:18.717763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:18.718498 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:18.718975 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:18.719428 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:18.861052 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:18.870449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-59540565-c61e-4fc0-9977-389b15282175 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1365 microversion: 2.1 time: 0.169300 Sep 23 15:35:18.871297 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 607/1248] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:18 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:19.899415 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:19.900378 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:19.904167 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:19.905461 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell0:SELECT=6 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:19.914084 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:19.914477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:19.914902 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:19.915589 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:19.916031 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:19.916443 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:20.051328 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:20.059368 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1ec20c9c-0043-4487-937a-aaead572d5ca tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1554 microversion: 2.1 time: 0.166577 Sep 23 15:35:20.059914 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 642/1249] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:19 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:20.081985 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:20.082515 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:20.084784 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell0:SELECT=6 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:20.090949 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:20.091408 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:20.092004 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:20.092838 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:20.093284 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:20.093720 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:20.172888 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3500f22c-68b4-4098-9b21-e5898da700a2 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094760 Sep 23 15:35:20.173499 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 608/1250] 10.222.0.75 () {58 vars in 1275 bytes} [Fri Sep 23 15:35:20 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:35:21.499430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-f4512adb-fbe4-4933-bf3a-4241b84212a4 req-503f2c15-196e-4956-94ea-b38a1a9165bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea1469c-a93c-4f28-9dc2-10168aa75991", "tag": "19763998-2ae2-48ae-9b03-3d196f0be1a2"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:21.509817 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f4512adb-fbe4-4933-bf3a-4241b84212a4 req-503f2c15-196e-4956-94ea-b38a1a9165bf service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:21.510305 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f4512adb-fbe4-4933-bf3a-4241b84212a4 req-503f2c15-196e-4956-94ea-b38a1a9165bf service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:21.510742 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f4512adb-fbe4-4933-bf3a-4241b84212a4 req-503f2c15-196e-4956-94ea-b38a1a9165bf service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:21.522459 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-f4512adb-fbe4-4933-bf3a-4241b84212a4 req-503f2c15-196e-4956-94ea-b38a1a9165bf service nova] Creating event network-changed:19763998-2ae2-48ae-9b03-3d196f0be1a2 for instance aea1469c-a93c-4f28-9dc2-10168aa75991 on hv-cinder-85501 Sep 23 15:35:21.527611 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-f4512adb-fbe4-4933-bf3a-4241b84212a4 req-503f2c15-196e-4956-94ea-b38a1a9165bf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096673 Sep 23 15:35:21.528282 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 643/1251] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:35:29.770269 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:29.770801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:29.772885 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:29.773536 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-f2c17d54-8c75-4c13-8acb-a66086b195ce req-f467da70-4377-4384-81df-4d5e5e88be39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39100324-7ac5-4a83-8822-9af1c2309671", "tag": "4b2b057f-9815-454d-a83b-9f55310e7e7a"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:29.779513 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:29.780309 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:29.780791 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:29.781485 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:29.782037 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:29.782189 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:29.782563 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:29.784812 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f2c17d54-8c75-4c13-8acb-a66086b195ce req-f467da70-4377-4384-81df-4d5e5e88be39 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:29.785477 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f2c17d54-8c75-4c13-8acb-a66086b195ce req-f467da70-4377-4384-81df-4d5e5e88be39 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:29.785903 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-f2c17d54-8c75-4c13-8acb-a66086b195ce req-f467da70-4377-4384-81df-4d5e5e88be39 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:29.788506 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:29.790635 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:29.799129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-f2c17d54-8c75-4c13-8acb-a66086b195ce req-f467da70-4377-4384-81df-4d5e5e88be39 service nova] Creating event network-changed:4b2b057f-9815-454d-a83b-9f55310e7e7a for instance 39100324-7ac5-4a83-8822-9af1c2309671 on hv-cinder-85501 Sep 23 15:35:29.805122 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-f2c17d54-8c75-4c13-8acb-a66086b195ce req-f467da70-4377-4384-81df-4d5e5e88be39 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037351 Sep 23 15:35:29.806125 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 644/1252] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:35:29.816331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:35:29.904014 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3fad2c96-eadd-4ac3-a78a-f22d4b98047b tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "DELETE /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 204 len: 0 microversion: 2.1 time: 0.138605 Sep 23 15:35:29.904894 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 609/1253] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:35:29 2022] DELETE /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:35:29.914762 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:29.915504 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:29.923177 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:29.923662 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:29.924096 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:29.924831 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:29.925281 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:29.925703 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:30.059809 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:30.068287 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-82afdfa9-c0f0-4034-8f8f-030591b2d2bf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1578 microversion: 2.1 time: 0.158806 Sep 23 15:35:30.069012 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 645/1254] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:29 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:31.101459 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:31.102755 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:31.109159 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:31.109688 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:31.110132 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:31.110829 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:31.111299 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:31.111718 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:31.298945 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:31.308695 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-62629690-c75b-47aa-9484-051de0ee57fe tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1578 microversion: 2.1 time: 0.214182 Sep 23 15:35:31.309313 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 610/1255] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:31 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:32.333352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:32.333970 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:32.341192 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:32.341672 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:32.342102 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:32.342851 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:32.343361 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:32.343927 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:32.482708 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:32.494558 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-8d3fc31d-36a7-4499-9137-c3734f494c8f req-14aae671-35bb-48b7-9eab-1d23978f7718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39100324-7ac5-4a83-8822-9af1c2309671", "name": "network-vif-deleted", "tag": "4b2b057f-9815-454d-a83b-9f55310e7e7a"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:32.496129 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5cc05bb4-d9c8-4f2b-a28b-329816593264 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 200 len: 1459 microversion: 2.1 time: 0.166668 Sep 23 15:35:32.496739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 646/1256] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:32 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 1459 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:32.505331 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-8d3fc31d-36a7-4499-9137-c3734f494c8f req-14aae671-35bb-48b7-9eab-1d23978f7718 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:32.505801 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-8d3fc31d-36a7-4499-9137-c3734f494c8f req-14aae671-35bb-48b7-9eab-1d23978f7718 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:32.506230 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-8d3fc31d-36a7-4499-9137-c3734f494c8f req-14aae671-35bb-48b7-9eab-1d23978f7718 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:32.517436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-8d3fc31d-36a7-4499-9137-c3734f494c8f req-14aae671-35bb-48b7-9eab-1d23978f7718 service nova] Creating event network-vif-deleted:4b2b057f-9815-454d-a83b-9f55310e7e7a for instance 39100324-7ac5-4a83-8822-9af1c2309671 on hv-cinder-85501 Sep 23 15:35:32.522186 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-8d3fc31d-36a7-4499-9137-c3734f494c8f req-14aae671-35bb-48b7-9eab-1d23978f7718 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031853 Sep 23 15:35:32.522842 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 611/1257] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:35:33.524017 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:33.524660 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 39100324-7ac5-4a83-8822-9af1c2309671] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:33.534618 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:33.535300 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:33.535865 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:33.537031 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:33.538089 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:33.538416 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:33.557662 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] HTTP exception thrown: Instance 39100324-7ac5-4a83-8822-9af1c2309671 could not be found. Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Request method failure captured: Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 HTTP/1.1 Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdBPmRnXYoif8Oafg0h_bp90e0G4G-707FIAByEXCw5Mij8RIgsapNEflc8qA4ss2e-goyTfBm2RtACpmGzgIai-nlNsDHah3-BqnwRY0uAgSAPWF8M-88wpeq2VNPocd24vKxn2GJ86QPqaXgGAq9Cl6cEte7TXmWAfMG_dXpZIa4Q Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:35:33.559298 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c05aa308acb842198935488c659d9ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c05aa308acb842198935488c659d9ab3"}]}] Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: cd5b918b0427408d9a70ca568d75ad58 Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 39100324-7ac5-4a83-8822-9af1c2309671 could not be found. Sep 23 15:35:33.561087 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '39100324-7ac5-4a83-8822-9af1c2309671'} Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39100324-7ac5-4a83-8822-9af1c2309671 could not be found. Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:35:33.561968 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39100324-7ac5-4a83-8822-9af1c2309671 could not be found. Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39100324-7ac5-4a83-8822-9af1c2309671 could not be found. Sep 23 15:35:33.563450 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:33.564788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Returning 404 to user: Instance 39100324-7ac5-4a83-8822-9af1c2309671 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:35:33.564788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-cc0a3e49-ca46-4cf5-a024-ffc8aa26c71e tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671" status: 404 len: 111 microversion: 2.1 time: 0.042698 Sep 23 15:35:33.564788 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 647/1258] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:33 2022] GET /compute/v2.1/servers/39100324-7ac5-4a83-8822-9af1c2309671 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:35:36.694973 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:36.695679 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:36.695805 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [req-07fc055a-ba12-4cb6-9894-6238d7f549d3 req-9e4cc838-bddb-45e9-affb-97bc85dbd911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea", "tag": "e2599f50-9d14-4ba1-bf63-bca221e1f35e"}]} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:36.703109 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:36.703740 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:36.704239 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:36.705344 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:36.705894 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:36.706164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-07fc055a-ba12-4cb6-9894-6238d7f549d3 req-9e4cc838-bddb-45e9-affb-97bc85dbd911 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:36.706500 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:36.706616 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-07fc055a-ba12-4cb6-9894-6238d7f549d3 req-9e4cc838-bddb-45e9-affb-97bc85dbd911 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:36.707061 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [req-07fc055a-ba12-4cb6-9894-6238d7f549d3 req-9e4cc838-bddb-45e9-affb-97bc85dbd911 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:36.719186 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.compute.server_external_events [req-07fc055a-ba12-4cb6-9894-6238d7f549d3 req-9e4cc838-bddb-45e9-affb-97bc85dbd911 service nova] Creating event network-changed:e2599f50-9d14-4ba1-bf63-bca221e1f35e for instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea on hv-cinder-85501 Sep 23 15:35:36.724274 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [req-07fc055a-ba12-4cb6-9894-6238d7f549d3 req-9e4cc838-bddb-45e9-affb-97bc85dbd911 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032322 Sep 23 15:35:36.725245 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 648/1259] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:35:36.738380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:35:36.853612 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-3feec174-016f-4e53-aebf-16c4f3d381c6 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "DELETE /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 204 len: 0 microversion: 2.1 time: 0.162979 Sep 23 15:35:36.855140 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 612/1260] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:35:36 2022] DELETE /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:35:36.864255 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:36.865669 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:36.873503 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:36.874121 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:36.874977 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:36.875808 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:36.876430 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:36.877200 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:37.028835 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:37.036566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-98b0b5b0-6413-4f2d-8c94-d366a6157ecb tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1578 microversion: 2.1 time: 0.177126 Sep 23 15:35:37.037152 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 649/1261] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:36 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:38.061415 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:38.062219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:38.069163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:38.069645 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:38.070074 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:38.070763 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:38.071201 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:38.071617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:38.249145 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:38.261992 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-5691fe08-48fa-4e86-a2fd-0b19b75ada15 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1578 microversion: 2.1 time: 0.205575 Sep 23 15:35:38.262908 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 613/1262] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:38 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1578 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:39.286044 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:39.286555 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:39.293786 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:39.294277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:39.294711 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:39.295412 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:39.295858 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:39.296277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:39.340562 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-176cd270-91d1-40ef-8f4a-ce803743f2f3 req-6c966e01-867a-4537-bd97-df87a5000c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea", "name": "network-vif-deleted", "tag": "e2599f50-9d14-4ba1-bf63-bca221e1f35e"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:35:39.353039 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-176cd270-91d1-40ef-8f4a-ce803743f2f3 req-6c966e01-867a-4537-bd97-df87a5000c94 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:39.353691 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-176cd270-91d1-40ef-8f4a-ce803743f2f3 req-6c966e01-867a-4537-bd97-df87a5000c94 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:39.354429 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-176cd270-91d1-40ef-8f4a-ce803743f2f3 req-6c966e01-867a-4537-bd97-df87a5000c94 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:39.362665 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd5b918b0427408d9a70ca568d75ad58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c05aa308acb842198935488c659d9ab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:35:39.368635 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-176cd270-91d1-40ef-8f4a-ce803743f2f3 req-6c966e01-867a-4537-bd97-df87a5000c94 service nova] Creating event network-vif-deleted:e2599f50-9d14-4ba1-bf63-bca221e1f35e for instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea on hv-cinder-85501 Sep 23 15:35:39.373297 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2c77fd19-e815-46ec-98d0-cefd8cc85cdf tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 200 len: 1392 microversion: 2.1 time: 0.090377 Sep 23 15:35:39.374009 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 650/1263] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:39 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 1392 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:35:39.374417 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-176cd270-91d1-40ef-8f4a-ce803743f2f3 req-6c966e01-867a-4537-bd97-df87a5000c94 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 Sep 23 15:35:39.375088 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 614/1264] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:35:40.397396 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:40.398041 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:40.405828 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:40.406332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:40.406772 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:40.407459 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:40.407916 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:40.408340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:40.422088 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] HTTP exception thrown: Instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea could not be found. Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Request method failure captured: Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea HTTP/1.1 Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdBPmRnXYoif8Oafg0h_bp90e0G4G-707FIAByEXCw5Mij8RIgsapNEflc8qA4ss2e-goyTfBm2RtACpmGzgIai-nlNsDHah3-BqnwRY0uAgSAPWF8M-88wpeq2VNPocd24vKxn2GJ86QPqaXgGAq9Cl6cEte7TXmWAfMG_dXpZIa4Q Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:35:40.423664 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c05aa308acb842198935488c659d9ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c05aa308acb842198935488c659d9ab3"}]}] Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: cd5b918b0427408d9a70ca568d75ad58 Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea could not be found. Sep 23 15:35:40.425406 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea'} Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea could not be found. Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:35:40.426584 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea could not be found. Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea could not be found. Sep 23 15:35:40.428193 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:40.429830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Returning 404 to user: Instance 61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:35:40.429830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ced79459-d79c-4401-8c2b-983eaa23a4d2 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea" status: 404 len: 111 microversion: 2.1 time: 0.031870 Sep 23 15:35:40.429830 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 651/1265] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:40 2022] GET /compute/v2.1/servers/61d1d62b-e50b-4f4d-9d7f-b7f7acc4f2ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:35:41.160713 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:41.161318 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:41.167531 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:41.168165 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:41.168623 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:41.169302 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:41.169745 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:41.170160 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:41.184542 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] HTTP exception thrown: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Request method failure captured: Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: DELETE /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c HTTP/1.1 Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdBPmRnXYoif8Oafg0h_bp90e0G4G-707FIAByEXCw5Mij8RIgsapNEflc8qA4ss2e-goyTfBm2RtACpmGzgIai-nlNsDHah3-BqnwRY0uAgSAPWF8M-88wpeq2VNPocd24vKxn2GJ86QPqaXgGAq9Cl6cEte7TXmWAfMG_dXpZIa4Q Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:35:41.186195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c05aa308acb842198935488c659d9ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c05aa308acb842198935488c659d9ab3"}]}] Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: cd5b918b0427408d9a70ca568d75ad58 Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.187866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'b43e17d3-319f-4b57-ae94-39d418139c9c'} Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:35:41.188950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.190543 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.192143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Returning 404 to user: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:35:41.192143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-541c93a8-2559-4ac2-9633-6d370b18ed85 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 404 len: 111 microversion: 2.1 time: 0.031816 Sep 23 15:35:41.192143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 615/1266] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:35:41 2022] DELETE /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:35:41.196457 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:41.197127 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] [instance: b43e17d3-319f-4b57-ae94-39d418139c9c] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:35:41.203727 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:41.204207 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:41.204667 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:41.205394 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:35:41.205851 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:35:41.206273 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:35:41.219963 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] HTTP exception thrown: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Request method failure captured: Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c HTTP/1.1 Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdBPmRnXYoif8Oafg0h_bp90e0G4G-707FIAByEXCw5Mij8RIgsapNEflc8qA4ss2e-goyTfBm2RtACpmGzgIai-nlNsDHah3-BqnwRY0uAgSAPWF8M-88wpeq2VNPocd24vKxn2GJ86QPqaXgGAq9Cl6cEte7TXmWAfMG_dXpZIa4Q Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:35:41.221509 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c05aa308acb842198935488c659d9ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c05aa308acb842198935488c659d9ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c05aa308acb842198935488c659d9ab3"}]}] Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: c05aa308acb842198935488c659d9ab3 Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-TestVolumeBootPattern-772363949 Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: cd5b918b0427408d9a70ca568d75ad58 Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-TestVolumeBootPattern-772363949-project Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.223237 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'b43e17d3-319f-4b57-ae94-39d418139c9c'} Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:35:41.224277 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. Sep 23 15:35:41.225988 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:35:41.227526 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Returning 404 to user: Instance b43e17d3-319f-4b57-ae94-39d418139c9c could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:35:41.227526 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-216fd38c-a871-44c6-afce-48ec18e8f0ca tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c" status: 404 len: 111 microversion: 2.1 time: 0.030388 Sep 23 15:35:41.227526 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 652/1267] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:35:41 2022] GET /compute/v2.1/servers/b43e17d3-319f-4b57-ae94-39d418139c9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:35:42.543525 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-7f59dcee-6861-44d0-a7db-b94369be2185 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] Calling method '.version_select at 0x7fbb0684c8b0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:35:42.567310 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-7f59dcee-6861-44d0-a7db-b94369be2185 tempest-TestVolumeBootPattern-772363949 tempest-TestVolumeBootPattern-772363949-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1827241209" status: 202 len: 0 microversion: 2.1 time: 0.027682 Sep 23 15:35:42.568128 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 616/1268] 10.222.0.75 () {58 vars in 1263 bytes} [Fri Sep 23 15:35:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1827241209 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:36:26.174113 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:26.174941 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:26.179135 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=17 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:26.180001 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=33 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:26.187768 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:26.188247 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:26.188701 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:26.189404 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:26.189969 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:26.190490 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:26.217046 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-bdb32192-2ec0-44e8-a774-f57a3227c224 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/ips" status: 200 len: 148 microversion: 2.1 time: 0.049311 Sep 23 15:36:26.217613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 653/1269] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:36:26 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/ips => generated 148 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:27.573617 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:27.574449 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:27.578614 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "744d2f6a-4277-4e30-9f0c-82a2a38eb5c5"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:36:27.581002 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:27.589723 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:27.590209 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:27.590646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:27.591341 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:27.591793 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:27.592217 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:27.878608 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-180323c2-a636-452a-b209-237619e196dc tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "POST /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306763 Sep 23 15:36:27.879218 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 617/1270] 10.222.0.75 () {60 vars in 1323 bytes} [Fri Sep 23 15:36:27 2022] POST /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:35.617260 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:35.617827 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:35.625800 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:35.626208 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:35.626640 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:35.627345 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:35.627800 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:35.628227 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:35.714535 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.objects.instance [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lazy-loading 'services' on Instance uuid aea1469c-a93c-4f28-9dc2-10168aa75991 {{(pid=120918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 15:36:35.792356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-98806a28-6ddf-41a4-b4ef-57c3a9ed2c35 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments/744d2f6a-4277-4e30-9f0c-82a2a38eb5c5" status: 202 len: 0 microversion: 2.1 time: 0.179460 Sep 23 15:36:35.792975 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 654/1271] 10.222.0.75 () {58 vars in 1416 bytes} [Fri Sep 23 15:36:35 2022] DELETE /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments/744d2f6a-4277-4e30-9f0c-82a2a38eb5c5 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 15:36:35.799810 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 15:36:35.800346 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Fri Sep 23 15:36:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments (ip 10.222.0.75) !!! Sep 23 15:36:35.805516 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:35.807900 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:35.815687 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:35.816190 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:35.816687 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:35.817469 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:35.817950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:35.818372 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:35.855481 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-0e43fb63-80bb-4125-985e-70af76b5f1aa tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057005 Sep 23 15:36:35.856019 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 618/1272] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:36:35 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:36.875873 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:36.880228 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:36.890719 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:36.891234 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:36.891644 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:36.892350 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:36.892843 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:36.893340 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:36.923410 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-64dd939d-1d19-411c-b1b5-47c49d541651 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057524 Sep 23 15:36:36.923961 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 655/1273] 10.222.0.75 () {58 vars in 1302 bytes} [Fri Sep 23 15:36:36 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 15:36:36.995329 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:36.995929 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:37.002634 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:37.003120 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:37.003558 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:37.004234 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:37.004724 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:37.005155 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:37.033950 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Going to try to terminate instance {{(pid=120919) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 15:36:37.120375 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-d5ec2b0d-4650-4bdc-9ddf-74c6711f1762 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 204 len: 0 microversion: 2.1 time: 0.129046 Sep 23 15:36:37.121295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 619/1274] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:36:36 2022] DELETE /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 15:36:37.132925 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:37.133492 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:37.139894 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:37.140369 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:37.140834 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:37.141522 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:37.141962 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:37.142384 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:37.283393 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:36:37.291599 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-ab8a395c-80a2-41da-a001-40d5e3debd47 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1678 microversion: 2.1 time: 0.163148 Sep 23 15:36:37.292160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 656/1275] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:36:37 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:36:38.321209 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:38.322402 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:38.330613 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:38.331105 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:38.331541 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:38.332237 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:38.332732 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:38.333161 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:38.475682 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.policy [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120919) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:36:38.484281 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-eb46a533-7681-490c-a964-ae5ebb255196 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1678 microversion: 2.1 time: 0.170255 Sep 23 15:36:38.484899 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 620/1276] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:36:38 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:36:39.507563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:39.508205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:39.515205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:39.515697 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:39.516123 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:39.516857 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:39.517311 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:39.517742 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:39.589164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.policy [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '338a34cb85d7455a9bed32158d4f9497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f43b3aab03420bbcb0a2b0f7a338ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120918) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 15:36:39.605686 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fa711720-c922-4bdb-8c5c-1bbc2d4c841a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 200 len: 1611 microversion: 2.1 time: 0.102047 Sep 23 15:36:39.608321 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 657/1277] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:36:39 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 1611 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 15:36:39.859146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [req-7c5f500d-a8bb-4ed2-aa55-bb568477e1a5 req-3595523a-0a74-44f2-b10f-b67775cef1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea1469c-a93c-4f28-9dc2-10168aa75991", "name": "network-vif-deleted", "tag": "19763998-2ae2-48ae-9b03-3d196f0be1a2"}]} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:36:39.876986 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7c5f500d-a8bb-4ed2-aa55-bb568477e1a5 req-3595523a-0a74-44f2-b10f-b67775cef1d4 service nova] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:39.877454 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7c5f500d-a8bb-4ed2-aa55-bb568477e1a5 req-3595523a-0a74-44f2-b10f-b67775cef1d4 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:39.877917 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [req-7c5f500d-a8bb-4ed2-aa55-bb568477e1a5 req-3595523a-0a74-44f2-b10f-b67775cef1d4 service nova] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:39.890607 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.compute.server_external_events [req-7c5f500d-a8bb-4ed2-aa55-bb568477e1a5 req-3595523a-0a74-44f2-b10f-b67775cef1d4 service nova] Creating event network-vif-deleted:19763998-2ae2-48ae-9b03-3d196f0be1a2 for instance aea1469c-a93c-4f28-9dc2-10168aa75991 on hv-cinder-85501 Sep 23 15:36:39.895470 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [req-7c5f500d-a8bb-4ed2-aa55-bb568477e1a5 req-3595523a-0a74-44f2-b10f-b67775cef1d4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040171 Sep 23 15:36:39.896389 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 621/1278] 10.222.0.75 () {64 vars in 1317 bytes} [Fri Sep 23 15:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:40.629811 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:40.630389 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:40.637562 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:40.638052 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:40.638471 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:40.639998 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:40.640472 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:40.640936 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:40.655870 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 HTTP/1.1 Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:36:40.657566 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:40.659171 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'aea1469c-a93c-4f28-9dc2-10168aa75991'} Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:40.660164 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:40.661731 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:40.663104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:40.663104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-8c0ac28e-8aa4-4f87-9e84-bde0f7b8ebf9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 404 len: 111 microversion: 2.1 time: 0.033260 Sep 23 15:36:40.663104 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 658/1279] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:36:40 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:40.668799 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-45fb3aa9-5092-4db7-a965-607e69242a3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '.version_select at 0x7fbb03007820>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:40.692097 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-45fb3aa9-5092-4db7-a965-607e69242a3e tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-387716221" status: 202 len: 0 microversion: 2.1 time: 0.027610 Sep 23 15:36:40.693058 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 622/1280] 10.222.0.75 () {58 vars in 1218 bytes} [Fri Sep 23 15:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-387716221 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:36:42.487524 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:42.488062 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:42.495238 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:42.495722 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:42.496161 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:42.496895 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:42.497352 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:42.497850 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:42.512033 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: DELETE /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 HTTP/1.1 Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:36:42.513613 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.515364 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'aea1469c-a93c-4f28-9dc2-10168aa75991'} Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:42.516431 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.518085 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.519721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:42.519721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-01471e66-c7ef-43ba-a116-f5ef5cca4684 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 404 len: 111 microversion: 2.1 time: 0.031598 Sep 23 15:36:42.519721 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 659/1281] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:36:42 2022] DELETE /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:42.524057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:42.524824 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: aea1469c-a93c-4f28-9dc2-10168aa75991] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:42.532551 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:42.533084 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:42.533530 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:42.534240 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:42.534692 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:42.535122 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:42.549547 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 HTTP/1.1 Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:36:42.551253 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.553100 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'aea1469c-a93c-4f28-9dc2-10168aa75991'} Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:42.554008 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. Sep 23 15:36:42.555379 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:42.556624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance aea1469c-a93c-4f28-9dc2-10168aa75991 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:42.556624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-ec410337-225b-4a30-a2f9-e7a6dc5c9fb9 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991" status: 404 len: 111 microversion: 2.1 time: 0.032703 Sep 23 15:36:42.556624 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 623/1282] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:36:42 2022] GET /compute/v2.1/servers/aea1469c-a93c-4f28-9dc2-10168aa75991 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:43.713912 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:43.714441 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:43.722604 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:43.723205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:43.723641 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:43.724346 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:43.724846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:43.725269 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:43.741262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: DELETE /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e HTTP/1.1 Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:36:43.742814 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.744488 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '3e1d775a-2566-40d4-a176-e03fc58b803e'} Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:43.745508 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.747099 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.748807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:43.748807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1832ff52-b025-44b6-9857-874c277a8f5a tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 404 len: 111 microversion: 2.1 time: 0.034313 Sep 23 15:36:43.748807 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 660/1283] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:36:43 2022] DELETE /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:43.752860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:43.753496 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 3e1d775a-2566-40d4-a176-e03fc58b803e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:43.760366 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:43.760897 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:43.761328 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:43.762015 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:43.762457 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:43.762873 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:43.777057 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e HTTP/1.1 Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:36:43.778629 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.780393 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '3e1d775a-2566-40d4-a176-e03fc58b803e'} Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:43.781524 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. Sep 23 15:36:43.783266 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.784971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance 3e1d775a-2566-40d4-a176-e03fc58b803e could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:43.784971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-18ad5fd8-4ed7-4afe-b5a9-853e51f07182 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e" status: 404 len: 111 microversion: 2.1 time: 0.031095 Sep 23 15:36:43.784971 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 624/1284] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:36:43 2022] GET /compute/v2.1/servers/3e1d775a-2566-40d4-a176-e03fc58b803e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:43.792650 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:43.793375 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:43.803045 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:43.803575 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:43.804205 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:43.805313 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:43.806070 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:43.809906 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:43.824532 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: DELETE /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e HTTP/1.1 Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:36:43.826239 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.828320 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e'} Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:43.829371 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.831005 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.832645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:43.832645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-79f2fdee-1469-4e8b-a294-e266ca645eb4 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 404 len: 111 microversion: 2.1 time: 0.041328 Sep 23 15:36:43.832645 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 661/1285] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:36:43 2022] DELETE /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:43.838494 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:43.839607 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:43.848012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:43.848861 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:43.849327 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:43.850146 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:43.850592 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:43.851012 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:43.866233 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e HTTP/1.1 Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:36:43.868420 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.870270 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e'} Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:43.871182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. Sep 23 15:36:43.872880 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:43.874345 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance 8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:43.874345 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-b962bcac-770c-4236-ae5c-d834e70ab522 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e" status: 404 len: 111 microversion: 2.1 time: 0.037190 Sep 23 15:36:43.874345 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 625/1286] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:36:43 2022] GET /compute/v2.1/servers/8ea3e9ed-e7cd-40d1-b460-3f43788c4b1e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:45.046614 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:45.047221 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.compute.api [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120918) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:45.054525 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:45.055009 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:45.055480 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:45.056191 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:45.056677 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:45.057109 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG oslo_concurrency.lockutils [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:45.071160 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: DELETE /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 HTTP/1.1 Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:36:45.072739 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: > Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.074438 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': 'e8313736-2707-4a7f-8b8f-2a1a33b07495'} Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:45.075583 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.077356 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.079024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:45.079024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-b6f60ee5-156f-4247-b5f3-ac1fb6889120 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 404 len: 111 microversion: 2.1 time: 0.032087 Sep 23 15:36:45.079024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 662/1287] 10.222.0.75 () {58 vars in 1239 bytes} [Fri Sep 23 15:36:45 2022] DELETE /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:45.083671 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Calling method '>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:45.084285 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.compute.api [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] [instance: e8313736-2707-4a7f-8b8f-2a1a33b07495] Fetching instance by UUID {{(pid=120919) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 15:36:45.090625 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:45.091106 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:45.091539 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:45.092228 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Acquiring lock "5e080b19-aa0c-4000-9579-fc774adbca9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 15:36:45.092711 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 15:36:45.093139 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG oslo_concurrency.lockutils [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Lock "5e080b19-aa0c-4000-9579-fc774adbca9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 15:36:45.106866 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] HTTP exception thrown: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Request method failure captured: Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 HTTP/1.1 Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdDNBxU_ICMLFMC-3NrCmVeCpa1WS07ztK0rr1CJxOruDYTJcdp76emnnN0z9avd4fne0QV-ddh_gdxvcFGYPjE7lQUutM2eo7H5j-BLB0RsB9VhuPB4Mqn591dr7YzVCOLu_oUHfJGM2uZeDylw__PiY9rhJoWppQ1OkuRnBrLDw08 Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:36:45.108380 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/58f43b3aab03420bbcb0a2b0f7a338ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/58f43b3aab03420bbcb0a2b0f7a338ac"}]}] Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: 58f43b3aab03420bbcb0a2b0f7a338ac Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553050794 Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 338a34cb85d7455a9bed32158d4f9497 Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-AttachVolumeNegativeTest-1553050794-project Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: > Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.110135 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': 'e8313736-2707-4a7f-8b8f-2a1a33b07495'} Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:45.111195 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. Sep 23 15:36:45.112854 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:45.114265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] Returning 404 to user: Instance e8313736-2707-4a7f-8b8f-2a1a33b07495 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:45.114265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-4c00e025-2d42-46e3-9338-6f4e567750a1 tempest-AttachVolumeNegativeTest-1553050794 tempest-AttachVolumeNegativeTest-1553050794-project] 10.222.0.75 "GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495" status: 404 len: 111 microversion: 2.1 time: 0.031004 Sep 23 15:36:45.114265 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 626/1288] 10.222.0.75 () {58 vars in 1236 bytes} [Fri Sep 23 15:36:45 2022] GET /compute/v2.1/servers/e8313736-2707-4a7f-8b8f-2a1a33b07495 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:49.979846 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-1136aa14-4f99-43bf-9630-35ad0c5ad068 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Action: 'create', calling method: .version_select at 0x7fbb0307c160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1012070270"}} {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:36:50.293262 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-1136aa14-4f99-43bf-9630-35ad0c5ad068 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.460119 Sep 23 15:36:50.294306 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 663/1289] 10.222.0.75 () {60 vars in 1155 bytes} [Fri Sep 23 15:36:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 462 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 15:36:50.307411 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-277f4756-9a7d-47cc-9755-263c92957527 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb067a7700>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:50.359295 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-277f4756-9a7d-47cc-9755-263c92957527 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88" status: 200 len: 345 microversion: 2.1 time: 0.055932 Sep 23 15:36:50.360007 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 627/1290] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:36:50 2022] GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:51.379337 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-5ff5c280-d30f-4c99-a4d8-53db9240e6e6 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02e87700>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:51.429563 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-5ff5c280-d30f-4c99-a4d8-53db9240e6e6 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88" status: 200 len: 346 microversion: 2.1 time: 0.057338 Sep 23 15:36:51.430138 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 664/1291] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:36:51 2022] GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:51.443822 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-f952e1cb-ba07-4025-a48e-758e3cd6ba3b tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Action: 'create', calling method: .version_select at 0x7fbb02d640d0>, body: {"snapshot": {"volume_id": "6f895339-9f7c-4550-ba32-a987f055db88", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1391147234"}} {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 15:36:51.604426 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-f952e1cb-ba07-4025-a48e-758e3cd6ba3b tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.164980 Sep 23 15:36:51.605079 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 628/1292] 10.222.0.75 () {60 vars in 1162 bytes} [Fri Sep 23 15:36:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:51.616853 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-fbb2b328-38d9-411e-a35a-2e3adb431c75 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02fc7670>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:51.647720 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-fbb2b328-38d9-411e-a35a-2e3adb431c75 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 200 len: 287 microversion: 2.1 time: 0.035532 Sep 23 15:36:51.648374 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 665/1293] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Sep 23 15:36:51 2022] GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:51.661185 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-eb3cbe16-a28b-468e-b6dc-1228660578db tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb067a7280>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:51.703110 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-eb3cbe16-a28b-468e-b6dc-1228660578db tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.046053 Sep 23 15:36:51.703646 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 629/1294] 10.222.0.75 () {58 vars in 1140 bytes} [Fri Sep 23 15:36:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 15:36:51.716189 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2f553f4f-5540-4021-9027-f32a3df73ba9 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb0307ce50>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:51.753978 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2f553f4f-5540-4021-9027-f32a3df73ba9 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 200 len: 287 microversion: 2.1 time: 0.041506 Sep 23 15:36:51.754546 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 666/1295] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Sep 23 15:36:51 2022] GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:52.771604 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-92ffb764-319b-4446-a250-4ca719a36bc4 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02d64f70>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:52.810032 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-92ffb764-319b-4446-a250-4ca719a36bc4 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 200 len: 287 microversion: 2.1 time: 0.045366 Sep 23 15:36:52.810782 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 630/1296] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Sep 23 15:36:52 2022] GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:53.828249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7c8c8233-570e-4f79-830d-819fe2714585 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb06808e50>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:53.860425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7c8c8233-570e-4f79-830d-819fe2714585 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 200 len: 287 microversion: 2.1 time: 0.039599 Sep 23 15:36:53.861024 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 667/1297] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Sep 23 15:36:53 2022] GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:54.878436 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-2de9f46f-b80b-4033-920c-b580e885f7c9 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02df38b0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:54.910419 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-2de9f46f-b80b-4033-920c-b580e885f7c9 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 200 len: 287 microversion: 2.1 time: 0.039191 Sep 23 15:36:54.910992 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 631/1298] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Sep 23 15:36:54 2022] GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:55.922124 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_api:SELECT=20 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:55.923265 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG dbcounter [-] [120918] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:55.930594 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-acf0aeac-57e1-476f-9d46-ee1f7ddf8fed tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb06808040>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:55.967343 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-acf0aeac-57e1-476f-9d46-ee1f7ddf8fed tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 200 len: 288 microversion: 2.1 time: 0.047293 Sep 23 15:36:55.967918 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 668/1299] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Sep 23 15:36:55 2022] GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 288 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:55.976826 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:55.977611 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG dbcounter [-] [120919] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:55.982536 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-87a0ada5-53b5-4acd-a49c-37b99e03961a tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02d64940>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:56.046528 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-87a0ada5-53b5-4acd-a49c-37b99e03961a tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 202 len: 0 microversion: 2.1 time: 0.070473 Sep 23 15:36:56.047162 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 632/1300] 10.222.0.75 () {58 vars in 1254 bytes} [Fri Sep 23 15:36:55 2022] DELETE /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:36:56.056064 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-e96adb65-93c2-4de9-9889-51cbe9f62a14 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02f85430>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:56.088878 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-e96adb65-93c2-4de9-9889-51cbe9f62a14 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 200 len: 287 microversion: 2.1 time: 0.036990 Sep 23 15:36:56.089451 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 669/1301] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Sep 23 15:36:56 2022] GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:57.103076 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fdd2876b-19a6-4ad7-966c-97fb0af93118 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb030774c0>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:57.131268 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-fdd2876b-19a6-4ad7-966c-97fb0af93118 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] HTTP exception thrown: Snapshot 123909f1-14f6-4fa2-9761-f49d5770a3c9 could not be found. Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fdd2876b-19a6-4ad7-966c-97fb0af93118 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Request method failure captured: Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 HTTP/1.1 Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdKRpFMe78dbba9S0LoEPjmD8HTKo15TLLbvyr4aqSK4MhczsfU4sZI6HZasd6UeBE6VyNrvZFYBqroMw6Z0ieDaD_Ddbnd7RJsA9n_Jr-8ohXHkxAezVehgZ3B_zfflxxj3JEF4IY4loy5m12EBhX_VxGUuB7iovRJlhS1y4vLTyZA Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: c87a7d5b3d1e4caa991fd9e89a5a2083 Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:36:57.136163 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}] Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: c87a7d5b3d1e4caa991fd9e89a5a2083 Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-VolumesSnapshotsTestJSON-1953734134-project Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 4d8caf7c512f486b85a50261c7cac17f Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1953734134-project Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Snapshot 123909f1-14f6-4fa2-9761-f49d5770a3c9 could not be found. Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '123909f1-14f6-4fa2-9761-f49d5770a3c9'} Sep 23 15:36:57.138149 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 123909f1-14f6-4fa2-9761-f49d5770a3c9 could not be found. (HTTP 404) (Request-ID: req-0161ec6f-60e3-4a60-84ea-78b2fe1fcd0c) Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:57.139465 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:36:57.141025 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 123909f1-14f6-4fa2-9761-f49d5770a3c9 could not be found. Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 23 15:36:57.144143 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 123909f1-14f6-4fa2-9761-f49d5770a3c9 could not be found. Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 123909f1-14f6-4fa2-9761-f49d5770a3c9 could not be found. Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-fdd2876b-19a6-4ad7-966c-97fb0af93118 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Returning 404 to user: Snapshot 123909f1-14f6-4fa2-9761-f49d5770a3c9 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:57.145860 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-fdd2876b-19a6-4ad7-966c-97fb0af93118 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9" status: 404 len: 111 microversion: 2.1 time: 0.039467 Sep 23 15:36:57.147775 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 633/1302] 10.222.0.75 () {58 vars in 1251 bytes} [Fri Sep 23 15:36:57 2022] GET /compute/v2.1/os-snapshots/123909f1-14f6-4fa2-9761-f49d5770a3c9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:57.148480 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-2ebf1f64-1093-43bc-b32f-4daae018e16a tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02fc79d0>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:57.230791 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-2ebf1f64-1093-43bc-b32f-4daae018e16a tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88" status: 202 len: 0 microversion: 2.1 time: 0.087303 Sep 23 15:36:57.231725 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 670/1303] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:36:57 2022] DELETE /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 15:36:57.241235 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e921f1c6-7f60-4ee9-a461-689c3aca81e9 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02d64160>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:57.297422 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e921f1c6-7f60-4ee9-a461-689c3aca81e9 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88" status: 200 len: 345 microversion: 2.1 time: 0.060840 Sep 23 15:36:57.297994 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 634/1304] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:36:57 2022] GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 15:36:58.313841 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7a1f0ce6-fb6e-4fb0-a481-325d99fb345e tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02fbab80>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:58.343407 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-7a1f0ce6-fb6e-4fb0-a481-325d99fb345e tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] HTTP exception thrown: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7a1f0ce6-fb6e-4fb0-a481-325d99fb345e tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Request method failure captured: Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 HTTP/1.1 Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdKRpFMe78dbba9S0LoEPjmD8HTKo15TLLbvyr4aqSK4MhczsfU4sZI6HZasd6UeBE6VyNrvZFYBqroMw6Z0ieDaD_Ddbnd7RJsA9n_Jr-8ohXHkxAezVehgZ3B_zfflxxj3JEF4IY4loy5m12EBhX_VxGUuB7iovRJlhS1y4vLTyZA Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: c87a7d5b3d1e4caa991fd9e89a5a2083 Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:36:58.345425 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}] Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: c87a7d5b3d1e4caa991fd9e89a5a2083 Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesSnapshotsTestJSON-1953734134-project Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4d8caf7c512f486b85a50261c7cac17f Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1953734134-project Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '6f895339-9f7c-4550-ba32-a987f055db88'} Sep 23 15:36:58.347246 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. (HTTP 404) (Request-ID: req-34b9ff96-eb68-4a0d-88df-83a9f2d11732) Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.348249 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:36:58.349872 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 15:36:58.351781 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-7a1f0ce6-fb6e-4fb0-a481-325d99fb345e tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Returning 404 to user: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-7a1f0ce6-fb6e-4fb0-a481-325d99fb345e tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88" status: 404 len: 109 microversion: 2.1 time: 0.037451 Sep 23 15:36:58.353243 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 671/1305] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:36:58 2022] GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:58.363182 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e9e96728-8118-462c-a8de-09ea522ebc47 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb032d0700>' {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:58.392865 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.wsgi [None req-e9e96728-8118-462c-a8de-09ea522ebc47 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] HTTP exception thrown: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e9e96728-8118-462c-a8de-09ea522ebc47 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Request method failure captured: Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: request: DELETE /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 HTTP/1.1 Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept: application/json Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Accept-Encoding: identity Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Connection: close Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Length: 0 Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Content-Type: application/json Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Host: 10.222.0.75 Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: Openstack-System-Scope: None Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Auth-Token: gAAAAABjLdKRpFMe78dbba9S0LoEPjmD8HTKo15TLLbvyr4aqSK4MhczsfU4sZI6HZasd6UeBE6VyNrvZFYBqroMw6Z0ieDaD_Ddbnd7RJsA9n_Jr-8ohXHkxAezVehgZ3B_zfflxxj3JEF4IY4loy5m12EBhX_VxGUuB7iovRJlhS1y4vLTyZA Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Id: None Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Domain-Name: None Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Identity-Status: Confirmed Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Is-Admin-Project: True Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Id: default Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Domain-Name: Default Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Id: c87a7d5b3d1e4caa991fd9e89a5a2083 Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Role: reader,member Sep 23 15:36:58.394808 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Roles: reader,member Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}] Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Id: c87a7d5b3d1e4caa991fd9e89a5a2083 Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User: tempest-VolumesSnapshotsTestJSON-1953734134-project Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Id: default Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Domain-Name: Default Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Id: 4d8caf7c512f486b85a50261c7cac17f Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1953734134-project Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: method: Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: exception: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: action_args: {'id': '6f895339-9f7c-4550-ba32-a987f055db88'} Sep 23 15:36:58.396638 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: {{(pid=120919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. (HTTP 404) (Request-ID: req-4cc2c20d-e708-4755-8b9e-245ae21a9aa7) Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.397622 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 15:36:58.399219 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 15:36:58.400972 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: DEBUG nova.api.openstack.wsgi [None req-e9e96728-8118-462c-a8de-09ea522ebc47 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Returning 404 to user: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. {{(pid=120919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:58.402552 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: INFO nova.api.openstack.requestlog [None req-e9e96728-8118-462c-a8de-09ea522ebc47 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88" status: 404 len: 109 microversion: 2.1 time: 0.038429 Sep 23 15:36:58.403615 dv-cinder-855013-3-iscsi devstack@n-api.service[120919]: [pid: 120919|app: 0|req: 635/1306] 10.222.0.75 () {58 vars in 1248 bytes} [Fri Sep 23 15:36:58 2022] DELETE /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 15:36:58.405155 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a5fb4c00-48d9-419d-86f9-e214460f1e77 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Calling method '.version_select at 0x7fbb02fbaee0>' {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 15:36:58.434691 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.wsgi [None req-a5fb4c00-48d9-419d-86f9-e214460f1e77 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] HTTP exception thrown: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a5fb4c00-48d9-419d-86f9-e214460f1e77 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Request method failure captured: Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: request: GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 HTTP/1.1 Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept: application/json Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Accept-Encoding: identity Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Connection: close Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Length: 0 Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Content-Type: application/json Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Host: 10.222.0.75 Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: Openstack-System-Scope: None Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: User-Agent: python-urllib3/1.26.12 Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Auth-Token: gAAAAABjLdKRpFMe78dbba9S0LoEPjmD8HTKo15TLLbvyr4aqSK4MhczsfU4sZI6HZasd6UeBE6VyNrvZFYBqroMw6Z0ieDaD_Ddbnd7RJsA9n_Jr-8ohXHkxAezVehgZ3B_zfflxxj3JEF4IY4loy5m12EBhX_VxGUuB7iovRJlhS1y4vLTyZA Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Id: None Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Domain-Name: None Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Identity-Status: Confirmed Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Is-Admin-Project: True Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Id: default Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Domain-Name: Default Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Id: c87a7d5b3d1e4caa991fd9e89a5a2083 Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Role: reader,member Sep 23 15:36:58.436633 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Roles: reader,member Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c87a7d5b3d1e4caa991fd9e89a5a2083"}]}] Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Id: c87a7d5b3d1e4caa991fd9e89a5a2083 Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1953734134 Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User: tempest-VolumesSnapshotsTestJSON-1953734134-project Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Id: default Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Domain-Name: Default Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Id: 4d8caf7c512f486b85a50261c7cac17f Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1953734134-project Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: method: Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: exception: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: action_args: {'id': '6f895339-9f7c-4550-ba32-a987f055db88'} Sep 23 15:36:58.438332 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: {{(pid=120918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. (HTTP 404) (Request-ID: req-5b8c8afe-d7a3-4d84-ac5c-f88b6fc10a17) Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.439479 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 15:36:58.440854 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 15:36:58.442296 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: ERROR nova.api.openstack.wsgi Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: DEBUG nova.api.openstack.wsgi [None req-a5fb4c00-48d9-419d-86f9-e214460f1e77 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] Returning 404 to user: Volume 6f895339-9f7c-4550-ba32-a987f055db88 could not be found. {{(pid=120918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: INFO nova.api.openstack.requestlog [None req-a5fb4c00-48d9-419d-86f9-e214460f1e77 tempest-VolumesSnapshotsTestJSON-1953734134 tempest-VolumesSnapshotsTestJSON-1953734134-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88" status: 404 len: 109 microversion: 2.1 time: 0.036774 Sep 23 15:36:58.444019 dv-cinder-855013-3-iscsi devstack@n-api.service[120918]: [pid: 120918|app: 0|req: 672/1307] 10.222.0.75 () {58 vars in 1245 bytes} [Fri Sep 23 15:36:58 2022] GET /compute/v2.1/os-volumes/6f895339-9f7c-4550-ba32-a987f055db88 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)